λ

Lab Monitor

REAL-TIME EXPERIMENT DASHBOARD

LIVE
--:--:--

实验数据总览

active experiments: 8  ·  timezone: UTC+8  ·  sorted by: last update
#01

Lab-2xA6000

▦ table
last update
260622-18:38:26
records
2000
type
text
latest
CUDA0: 45GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 44242MB | CUDA1 PID:[4046156] 30516MB | CUDA1 PID:[4112949] 6684MB)
ID数值接收时间
30330CUDA0: 45GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 44242MB | CUDA1 PID:[4046156] 30516MB | CUDA1 PID:[4112949] 6684MB)260622-18:38:26 (UTC+8)
30329CUDA0: 45GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 44242MB | CUDA1 PID:[4046156] 23694MB | CUDA1 PID:[4112949] 6684MB)260622-18:36:51 (UTC+8)
30328CUDA0: 34GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 33082MB | CUDA1 PID:[4046156] 41722MB | CUDA1 PID:[4112949] 6684MB)260622-18:35:16 (UTC+8)
30327CUDA0: 47GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 46682MB | CUDA1 PID:[4046156] 28882MB | CUDA1 PID:[4112949] 6684MB)260622-18:32:03 (UTC+8)
30326CUDA0: 22GB / 48GB 100% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 20744MB | CUDA1 PID:[4046156] 18464MB | CUDA1 PID:[4112949] 6684MB)260622-18:30:28 (UTC+8)
30325CUDA0: 30GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 29336MB | CUDA1 PID:[4046156] 41476MB | CUDA1 PID:[4112949] 6684MB)260622-18:28:53 (UTC+8)
30324CUDA0: 37GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 36882MB | CUDA1 PID:[4046156] 21598MB | CUDA1 PID:[3724106] 6692MB)260622-18:27:18 (UTC+8)
30323CUDA0: 41GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4046155] 40698MB | CUDA1 PID:[4046156] 31798MB | CUDA1 PID:[3724106] 6692MB)260622-18:25:44 (UTC+8)
30322CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[3724106] 6692MB)260622-18:24:09 (UTC+8)
30321CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[3724106] 6692MB)260622-18:22:34 (UTC+8)
30320CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:20:59 (UTC+8)
30319CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:19:24 (UTC+8)
30318CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:17:49 (UTC+8)
30317CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:16:15 (UTC+8)
30316CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:14:41 (UTC+8)
30315CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:13:06 (UTC+8)
30314CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:11:31 (UTC+8)
30313CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:09:56 (UTC+8)
30312CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:08:22 (UTC+8)
30311CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3724106] 6692MB)260622-18:06:47 (UTC+8)
30310CUDA0: 45GB / 48GB 92% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44318MB | CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3108053] 6692MB)260622-18:05:12 (UTC+8)
30309CUDA0: 45GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44318MB | CUDA1 PID:[2999291] 37400MB | CUDA1 PID:[3108053] 6692MB)260622-18:03:37 (UTC+8)
30308CUDA0: 45GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44318MB | CUDA1 PID:[2999291] 31480MB | CUDA1 PID:[3108053] 6692MB)260622-18:02:02 (UTC+8)
30307CUDA0: 45GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44318MB | CUDA1 PID:[2999291] 31478MB | CUDA1 PID:[3108053] 6692MB)260622-18:00:27 (UTC+8)
30306CUDA0: 45GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44318MB | CUDA1 PID:[2999291] 31478MB | CUDA1 PID:[3108053] 6692MB)260622-17:58:53 (UTC+8)
30305CUDA0: 34GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 32878MB | CUDA1 PID:[2999291] 31478MB | CUDA1 PID:[3108053] 6692MB)260622-17:57:18 (UTC+8)
30304CUDA0: 14GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 12642MB | CUDA1 PID:[2999291] 19958MB | CUDA1 PID:[3108053] 6692MB)260622-17:55:43 (UTC+8)
30303CUDA0: 22GB / 48GB 96% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 20938MB | CUDA1 PID:[2999291] 33300MB | CUDA1 PID:[3108053] 6692MB)260622-17:54:09 (UTC+8)
30302CUDA0: 29GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 28236MB | CUDA1 PID:[2999291] 33300MB | CUDA1 PID:[3108053] 6692MB)260622-17:52:34 (UTC+8)
30301CUDA0: 35GB / 48GB 95% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 34316MB | CUDA1 PID:[2999291] 33300MB | CUDA1 PID:[3108053] 6692MB)260622-17:51:00 (UTC+8)
30300CUDA0: 38GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 37398MB | CUDA1 PID:[2999291] 32420MB | CUDA1 PID:[3108053] 6692MB)260622-17:49:25 (UTC+8)
30299CUDA0: 45GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44180MB | CUDA1 PID:[2999291] 32420MB | CUDA1 PID:[3108053] 6692MB)260622-17:47:50 (UTC+8)
30298CUDA0: 47GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 46522MB | CUDA1 PID:[2999291] 32420MB | CUDA1 PID:[3108053] 6692MB)260622-17:46:16 (UTC+8)
30297CUDA0: 45GB / 48GB 100% || CUDA1: 38GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44522MB | CUDA1 PID:[2999291] 32420MB | CUDA1 PID:[3108053] 6692MB)260622-17:44:41 (UTC+8)
30296CUDA0: 45GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44242MB | CUDA1 PID:[2999291] 32420MB | CUDA1 PID:[3108053] 6692MB)260622-17:41:27 (UTC+8)
30295CUDA0: 45GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44242MB | CUDA1 PID:[2999291] 24400MB | CUDA1 PID:[3108053] 6692MB)260622-17:39:52 (UTC+8)
30294CUDA0: 45GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44242MB | CUDA1 PID:[2999291] 24400MB | CUDA1 PID:[3108053] 6692MB)260622-17:38:17 (UTC+8)
30293CUDA0: 45GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44238MB | CUDA1 PID:[2999291] 24398MB | CUDA1 PID:[3108053] 6692MB)260622-17:36:43 (UTC+8)
30292CUDA0: 45GB / 48GB 92% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 44238MB | CUDA1 PID:[2999291] 24398MB | CUDA1 PID:[3108053] 6692MB)260622-17:35:08 (UTC+8)
30291CUDA0: 34GB / 48GB 100% || CUDA1: 30GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 33078MB | CUDA1 PID:[2999291] 24398MB | CUDA1 PID:[3108053] 6692MB)260622-17:33:33 (UTC+8)
30290CUDA0: 23GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 21378MB | CUDA1 PID:[2999291] 21618MB | CUDA1 PID:[3108053] 6692MB)260622-17:31:58 (UTC+8)
30289CUDA0: 33GB / 48GB 100% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 31978MB | CUDA1 PID:[2999291] 13974MB | CUDA1 PID:[3108053] 6692MB)260622-17:30:24 (UTC+8)
30288CUDA0: 39GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 38394MB | CUDA1 PID:[2999291] 21816MB | CUDA1 PID:[3075301] 6692MB)260622-17:28:49 (UTC+8)
30287CUDA0: 44GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 43476MB | CUDA1 PID:[2999291] 32036MB)260622-17:27:14 (UTC+8)
30286CUDA0: 39GB / 48GB 93% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 37496MB | CUDA1 PID:[2999291] 45018MB)260622-17:25:39 (UTC+8)
30285CUDA0: 18GB / 48GB 100% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2999290] 16212MB | CUDA1 PID:[2999291] 15894MB)260622-17:24:04 (UTC+8)
30284CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-17:22:30 (UTC+8)
30283CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-17:20:55 (UTC+8)
30282CUDA0: 34GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 32878MB | CUDA1 PID:[2363005] 36162MB)260622-17:19:20 (UTC+8)
30281CUDA0: 35GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 33674MB | CUDA1 PID:[2363005] 36162MB)260622-17:17:45 (UTC+8)
30280CUDA0: 38GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 37242MB | CUDA1 PID:[2363005] 36162MB)260622-17:16:10 (UTC+8)
30279CUDA0: 42GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 41742MB | CUDA1 PID:[2363005] 36162MB)260622-17:14:35 (UTC+8)
30278CUDA0: 45GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 44202MB | CUDA1 PID:[2363005] 36162MB)260622-17:13:00 (UTC+8)
30277CUDA0: 46GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 45722MB | CUDA1 PID:[2363005] 36162MB)260622-17:09:46 (UTC+8)
30276CUDA0: 45GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 44522MB | CUDA1 PID:[2363005] 36162MB)260622-17:08:11 (UTC+8)
30275CUDA0: 45GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 44522MB | CUDA1 PID:[2363005] 34882MB)260622-17:06:36 (UTC+8)
30274CUDA0: 45GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 44522MB | CUDA1 PID:[2363005] 34882MB)260622-17:05:01 (UTC+8)
30273CUDA0: 45GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 44242MB | CUDA1 PID:[2363005] 34882MB)260622-17:03:26 (UTC+8)
30272CUDA0: 45GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 44242MB | CUDA1 PID:[2363005] 34882MB)260622-17:00:12 (UTC+8)
30271CUDA0: 38GB / 48GB 100% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 37594MB | CUDA1 PID:[2363005] 20042MB)260622-16:52:01 (UTC+8)
30270CUDA0: 15GB / 48GB 0% || CUDA1: 14GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[2363004] 13932MB | CUDA1 PID:[2363005] 14420MB)260622-16:47:08 (UTC+8)
30269CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:45:33 (UTC+8)
30268CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:43:58 (UTC+8)
30267CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:40:45 (UTC+8)
30266CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:39:10 (UTC+8)
30265CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:26:02 (UTC+8)
30264CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:24:28 (UTC+8)
30263CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:22:53 (UTC+8)
30262CUDA0: 2GB / 48GB 42% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:21:18 (UTC+8)
30261CUDA0: 15GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1766371] 13564MB | CUDA1 PID:[1766372] 23720MB)260622-16:18:04 (UTC+8)
30260CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:08:14 (UTC+8)
30259CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-16:06:39 (UTC+8)
30258CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 85% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6784MB)260622-16:03:25 (UTC+8)
30257CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6784MB)260622-16:01:50 (UTC+8)
30256CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6784MB)260622-16:00:15 (UTC+8)
30255CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 85% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6784MB)260622-15:58:40 (UTC+8)
30254CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6782MB)260622-15:55:27 (UTC+8)
30253CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6782MB)260622-15:53:52 (UTC+8)
30252CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6782MB)260622-15:50:38 (UTC+8)
30251CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6692MB)260622-15:49:04 (UTC+8)
30250CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6692MB)260622-15:45:50 (UTC+8)
30249CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 96% [双卡负载] (高占用进程: CUDA1 PID:[1188370] 6692MB)260622-15:44:15 (UTC+8)
30248CUDA0: 19GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 23304MB | CUDA1 PID:[1188370] 6692MB)260622-15:41:01 (UTC+8)
30247CUDA0: 19GB / 48GB 100% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 17684MB)260622-15:39:26 (UTC+8)
30246CUDA0: 19GB / 48GB 100% || CUDA1: 24GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:37:51 (UTC+8)
30245CUDA0: 38GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 37304MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:36:17 (UTC+8)
30244CUDA0: 38GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 37304MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:34:42 (UTC+8)
30243CUDA0: 38GB / 48GB 100% || CUDA1: 24GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[519771] 37304MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:33:07 (UTC+8)
30242CUDA0: 38GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 37304MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:31:32 (UTC+8)
30241CUDA0: 36GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 34624MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:29:57 (UTC+8)
30240CUDA0: 22GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 20724MB | CUDA1 PID:[519772] 17684MB | CUDA1 PID:[249672] 6782MB)260622-15:28:23 (UTC+8)
30239CUDA0: 19GB / 48GB 95% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:26:48 (UTC+8)
30238CUDA0: 19GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:25:13 (UTC+8)
30237CUDA0: 19GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:23:38 (UTC+8)
30236CUDA0: 19GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:22:03 (UTC+8)
30235CUDA0: 19GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 17684MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:20:29 (UTC+8)
30234CUDA0: 25GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 24204MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:18:55 (UTC+8)
30233CUDA0: 25GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 24204MB | CUDA1 PID:[519772] 23644MB | CUDA1 PID:[249672] 6782MB)260622-15:17:20 (UTC+8)
30232CUDA0: 25GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 24204MB | CUDA1 PID:[519772] 22164MB | CUDA1 PID:[249672] 6782MB)260622-15:15:45 (UTC+8)
30231CUDA0: 24GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 23304MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:14:11 (UTC+8)
30230CUDA0: 24GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 23304MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:12:36 (UTC+8)
30229CUDA0: 18GB / 48GB 95% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 16604MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:11:02 (UTC+8)
30228CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 16604MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:09:27 (UTC+8)
30227CUDA0: 16GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 14944MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:07:52 (UTC+8)
30226CUDA0: 16GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 14944MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:06:18 (UTC+8)
30225CUDA0: 16GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 14584MB | CUDA1 PID:[519772] 16244MB | CUDA1 PID:[249672] 6782MB)260622-15:04:43 (UTC+8)
30224CUDA0: 16GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[519771] 14284MB | CUDA1 PID:[519772] 12064MB | CUDA1 PID:[249672] 6782MB)260622-15:03:08 (UTC+8)
30223CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 96% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6782MB)260622-15:01:34 (UTC+8)
30222CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6782MB)260622-14:59:59 (UTC+8)
30221CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6782MB)260622-14:58:24 (UTC+8)
30220CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6782MB)260622-14:56:49 (UTC+8)
30219CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6692MB)260622-14:55:14 (UTC+8)
30218CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6692MB)260622-14:53:39 (UTC+8)
30217CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 92% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6692MB)260622-14:52:05 (UTC+8)
30216CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 95% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6692MB)260622-14:50:30 (UTC+8)
30215CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[249672] 6692MB)260622-14:48:55 (UTC+8)
30214CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:45:42 (UTC+8)
30213CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:40:49 (UTC+8)
30212CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:37:35 (UTC+8)
30211CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:36:00 (UTC+8)
30210CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:34:25 (UTC+8)
30209CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:32:51 (UTC+8)
30208CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 84% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6782MB)260622-14:31:16 (UTC+8)
30207CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 94% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6692MB)260622-14:29:41 (UTC+8)
30206CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 95% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6692MB)260622-14:28:07 (UTC+8)
30205CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6692MB)260622-14:26:32 (UTC+8)
30204CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6692MB)260622-14:24:58 (UTC+8)
30203CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3983277] 6692MB)260622-14:23:23 (UTC+8)
30202CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-14:21:48 (UTC+8)
30201CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[3923840] 6342MB)260622-14:20:13 (UTC+8)
30200CUDA0: 40GB / 48GB 93% || CUDA1: 2GB / 48GB 88% [双卡负载] (高占用进程: CUDA0 PID:[3877454] 37742MB | CUDA1 PID:[3870744] 2388MB)260622-14:18:38 (UTC+8)
30199CUDA0: 31GB / 48GB 93% || CUDA1: 45GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3877454] 29242MB | CUDA1 PID:[3870744] 45262MB)260622-14:17:03 (UTC+8)
30198CUDA0: 31GB / 48GB 100% || CUDA1: 45GB / 48GB 87% [双卡负载] (高占用进程: CUDA0 PID:[3821226] 31902MB | CUDA1 PID:[3811388] 44728MB)260622-14:15:28 (UTC+8)
30197CUDA0: 37GB / 48GB 91% || CUDA1: 40GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[3821226] 35162MB | CUDA1 PID:[3811388] 40382MB)260622-14:13:53 (UTC+8)
30196CUDA0: 40GB / 48GB 92% || CUDA1: 13GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[3764717] 37838MB | CUDA1 PID:[3755506] 12698MB)260622-14:12:18 (UTC+8)
30195CUDA0: 25GB / 48GB 100% || CUDA1: 13GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3764717] 24298MB | CUDA1 PID:[3755506] 13098MB)260622-14:10:44 (UTC+8)
30194CUDA0: 29GB / 48GB 92% || CUDA1: 26GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3712972] 27082MB | CUDA1 PID:[3700316] 27022MB)260622-14:09:09 (UTC+8)
30193CUDA0: 7GB / 48GB 89% || CUDA1: 31GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3657585] 5328MB | CUDA1 PID:[3700316] 32162MB)260622-14:07:34 (UTC+8)
30192CUDA0: 29GB / 48GB 98% || CUDA1: 8GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[3657585] 28442MB | CUDA1 PID:[3647992] 8058MB)260622-14:06:00 (UTC+8)
30191CUDA0: 4GB / 48GB 88% || CUDA1: 30GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3647373] 2624MB | CUDA1 PID:[3647992] 30798MB)260622-14:04:25 (UTC+8)
30190CUDA0: 10GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3602007] 8422MB | CUDA1 PID:[3591404] 19762MB)260622-14:02:50 (UTC+8)
30189CUDA0: 7GB / 48GB 85% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3548193] 5328MB | CUDA1 PID:[3591404] 34962MB)260622-14:01:16 (UTC+8)
30188CUDA0: 28GB / 48GB 100% || CUDA1: 24GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3548193] 28962MB | CUDA1 PID:[3538434] 24162MB)260622-13:59:41 (UTC+8)
30187CUDA0: 7GB / 48GB 87% || CUDA1: 2GB / 48GB 90% [双卡负载] (高占用进程: CUDA0 PID:[3484723] 5328MB | CUDA1 PID:[3529614] 2326MB)260622-13:58:06 (UTC+8)
30186CUDA0: 39GB / 48GB 98% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3484723] 38262MB | CUDA1 PID:[3464352] 46762MB)260622-13:56:31 (UTC+8)
30185CUDA0: 9GB / 48GB 89% || CUDA1: 34GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[3431703] 7848MB | CUDA1 PID:[3464352] 35002MB)260622-13:54:56 (UTC+8)
30184CUDA0: 18GB / 48GB 91% || CUDA1: 15GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[3431703] 16062MB | CUDA1 PID:[3399508] 14388MB)260622-13:53:22 (UTC+8)
30183CUDA0: 17GB / 48GB 99% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3378034] 16322MB | CUDA1 PID:[3399508] 47722MB)260622-13:51:47 (UTC+8)
30182CUDA0: 28GB / 48GB 99% || CUDA1: 10GB / 48GB 89% [双卡负载] (高占用进程: CUDA0 PID:[3378034] 26442MB | CUDA1 PID:[3344917] 10488MB)260622-13:50:12 (UTC+8)
30181CUDA0: 33GB / 48GB 100% || CUDA1: 8GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[3324681] 34598MB | CUDA1 PID:[3344917] 7998MB)260622-13:48:37 (UTC+8)
30180CUDA0: 27GB / 48GB 93% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3324681] 24878MB | CUDA1 PID:[3289245] 24822MB)260622-13:47:03 (UTC+8)
30179CUDA0: 19GB / 48GB 98% || CUDA1: 7GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[3271857] 17842MB | CUDA1 PID:[3289245] 6702MB)260622-13:45:28 (UTC+8)
30178CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[3233065] 4982MB)260622-13:43:53 (UTC+8)
30177CUDA0: 28GB / 48GB 99% || CUDA1: 6GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[3217749] 29018MB | CUDA1 PID:[3233065] 6502MB)260622-13:42:18 (UTC+8)
30176CUDA0: 4GB / 48GB 86% || CUDA1: 23GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3205992] 2624MB | CUDA1 PID:[3174076] 23182MB)260622-13:40:43 (UTC+8)
30175CUDA0: 27GB / 48GB 90% || CUDA1: 18GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3150308] 24422MB | CUDA1 PID:[3174076] 20002MB)260622-13:39:08 (UTC+8)
30174CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[3117978] 22142MB)260622-13:37:33 (UTC+8)
30173CUDA0: 28GB / 48GB 98% || CUDA1: 47GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3096863] 26442MB | CUDA1 PID:[3117978] 48282MB)260622-13:35:58 (UTC+8)
30172CUDA0: 6GB / 48GB 86% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3086196] 4168MB | CUDA1 PID:[3063419] 19022MB)260622-13:34:24 (UTC+8)
30171CUDA0: 9GB / 48GB 90% || CUDA1: 2GB / 48GB 89% [双卡负载] (高占用进程: CUDA0 PID:[3009164] 7848MB | CUDA1 PID:[3008809] 2388MB)260622-13:32:49 (UTC+8)
30170CUDA0: 7GB / 48GB 92% || CUDA1: 19GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3009164] 7762MB | CUDA1 PID:[3008809] 19202MB)260622-13:31:14 (UTC+8)
30169CUDA0: 7GB / 48GB 90% || CUDA1: 3GB / 48GB 86% [双卡负载] (高占用进程: CUDA0 PID:[3001253] 5148MB | CUDA1 PID:[3000568] 3508MB)260622-13:29:39 (UTC+8)
30168CUDA0: 34GB / 48GB 93% || CUDA1: 18GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3001253] 31822MB | CUDA1 PID:[3000568] 19902MB)260622-13:28:04 (UTC+8)
30167CUDA0: 41GB / 48GB 100% || CUDA1: 41GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[2992977] 40558MB | CUDA1 PID:[2992548] 41078MB)260622-13:26:29 (UTC+8)
30166CUDA0: 15GB / 48GB 92% || CUDA1: 28GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[2992977] 11898MB | CUDA1 PID:[2992548] 27718MB)260622-13:24:55 (UTC+8)
30165CUDA0: 34GB / 48GB 97% || CUDA1: 8GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2983092] 34122MB | CUDA1 PID:[2982576] 9502MB)260622-13:23:20 (UTC+8)
30164CUDA0: 43GB / 48GB 100% || CUDA1: 19GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[2983092] 42562MB | CUDA1 PID:[2982576] 19782MB)260622-13:21:45 (UTC+8)
30163CUDA0: 10GB / 48GB 96% || CUDA1: 46GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[2972926] 9642MB | CUDA1 PID:[2972182] 48438MB)260622-13:20:10 (UTC+8)
30162CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2972182] 6378MB)260622-13:18:35 (UTC+8)
30161CUDA0: 15GB / 48GB 97% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2955788] 13762MB | CUDA1 PID:[2960375] 46982MB)260622-13:17:01 (UTC+8)
30160CUDA0: 35GB / 48GB 98% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[2955788] 34742MB)260622-13:15:26 (UTC+8)
30159CUDA0: 22GB / 48GB 93% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2920270] 19802MB | CUDA1 PID:[2922670] 33682MB)260622-13:13:52 (UTC+8)
30158CUDA0: 2GB / 48GB 0% || CUDA1: 4GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[2917735] 3728MB)260622-13:12:17 (UTC+8)
30157CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-13:10:42 (UTC+8)
30156CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-13:09:07 (UTC+8)
30155CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-13:07:32 (UTC+8)
30154CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-13:05:57 (UTC+8)
30153CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-13:04:22 (UTC+8)
30152CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-13:02:47 (UTC+8)
30151CUDA0: 2GB / 48GB 0% || CUDA1: 2GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2761491] 2362MB)260622-13:01:12 (UTC+8)
30150CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:59:37 (UTC+8)
30149CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:58:02 (UTC+8)
30148CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:56:27 (UTC+8)
30147CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:54:52 (UTC+8)
30146CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:53:17 (UTC+8)
30145CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:51:43 (UTC+8)
30144CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:48:29 (UTC+8)
30143CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:46:54 (UTC+8)
30142CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:42:00 (UTC+8)
30141CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:38:46 (UTC+8)
30140CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:37:12 (UTC+8)
30139CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:30:40 (UTC+8)
30138CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:25:47 (UTC+8)
30137CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:19:15 (UTC+8)
30136CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-12:14:21 (UTC+8)
30135CUDA0: 11GB / 48GB 70% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1872861] 9354MB | CUDA1 PID:[2100130] 12836MB | CUDA1 PID:[1872867] 9168MB)260622-12:09:29 (UTC+8)
30134CUDA0: 2GB / 48GB 33% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1945723] 12836MB | CUDA1 PID:[1872867] 9170MB)260622-11:58:00 (UTC+8)
30133CUDA0: 11GB / 48GB 56% || CUDA1: 9GB / 48GB 60% [双卡负载] (高占用进程: CUDA0 PID:[1872861] 9170MB | CUDA1 PID:[1872867] 9146MB)260622-11:54:45 (UTC+8)
30132CUDA0: 11GB / 48GB 73% || CUDA1: 9GB / 48GB 72% [双卡负载] (高占用进程: CUDA0 PID:[1872861] 9144MB | CUDA1 PID:[1872867] 9232MB)260622-11:53:10 (UTC+8)
30131CUDA0: 11GB / 48GB 81% || CUDA1: 9GB / 48GB 82% [双卡负载] (高占用进程: CUDA0 PID:[1872861] 9202MB | CUDA1 PID:[1872867] 9180MB)260622-11:51:35 (UTC+8)
30130CUDA0: 11GB / 48GB 82% || CUDA1: 9GB / 48GB 78% [双卡负载] (高占用进程: CUDA0 PID:[1702025] 9172MB | CUDA1 PID:[1702027] 9358MB)260622-11:45:03 (UTC+8)
30129CUDA0: 11GB / 48GB 86% || CUDA1: 9GB / 48GB 80% [双卡负载] (高占用进程: CUDA0 PID:[1702025] 9172MB | CUDA1 PID:[1702027] 9176MB)260622-11:38:31 (UTC+8)
30128CUDA0: 11GB / 48GB 82% || CUDA1: 9GB / 48GB 80% [双卡负载] (高占用进程: CUDA0 PID:[1702025] 9142MB | CUDA1 PID:[1702027] 9146MB)260622-11:36:56 (UTC+8)
30127CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:35:21 (UTC+8)
30126CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:33:47 (UTC+8)
30125CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:32:12 (UTC+8)
30124CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:25:40 (UTC+8)
30123CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:24:05 (UTC+8)
30122CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:22:30 (UTC+8)
30121CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:20:55 (UTC+8)
30120CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:16:02 (UTC+8)
30119CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-11:14:28 (UTC+8)
30118CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[1238156] 6692MB)260622-11:09:35 (UTC+8)
30117CUDA0: 2GB / 48GB 0% || CUDA1: 16GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[1269154] 9176MB | CUDA1 PID:[1238156] 6692MB)260622-11:06:21 (UTC+8)
30116CUDA0: 11GB / 48GB 56% || CUDA1: 15GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1269145] 9172MB | CUDA1 PID:[1269154] 9146MB | CUDA1 PID:[1238156] 6692MB)260622-11:03:07 (UTC+8)
30115CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[992304] 6692MB)260622-10:58:14 (UTC+8)
30114CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[992304] 6692MB)260622-10:56:39 (UTC+8)
30113CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[992304] 6692MB)260622-10:55:04 (UTC+8)
30112CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[992304] 6692MB)260622-10:53:29 (UTC+8)
30111CUDA0: 2GB / 48GB 0% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1050419] 9142MB | CUDA1 PID:[992304] 6692MB)260622-10:51:54 (UTC+8)
30110CUDA0: 2GB / 48GB 0% || CUDA1: 14GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[1050419] 8138MB | CUDA1 PID:[992304] 6692MB)260622-10:50:20 (UTC+8)
30109CUDA0: 11GB / 48GB 81% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1049996] 9114MB | CUDA1 PID:[1050419] 9144MB | CUDA1 PID:[992304] 6692MB)260622-10:48:45 (UTC+8)
30108CUDA0: 11GB / 48GB 70% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1049996] 9148MB | CUDA1 PID:[1050419] 9140MB | CUDA1 PID:[992304] 6692MB)260622-10:47:10 (UTC+8)
30107CUDA0: 11GB / 48GB 75% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1049996] 9114MB | CUDA1 PID:[1050419] 9128MB | CUDA1 PID:[992304] 6692MB)260622-10:45:35 (UTC+8)
30106CUDA0: 11GB / 48GB 81% || CUDA1: 15GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1049996] 9124MB | CUDA1 PID:[1050419] 9122MB | CUDA1 PID:[992304] 6692MB)260622-10:44:00 (UTC+8)
30105CUDA0: 11GB / 48GB 84% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[856768] 9148MB | CUDA1 PID:[968911] 9148MB | CUDA1 PID:[992304] 6692MB)260622-10:40:46 (UTC+8)
30104CUDA0: 11GB / 48GB 83% || CUDA1: 9GB / 48GB 77% [双卡负载] (高占用进程: CUDA0 PID:[856768] 9174MB | CUDA1 PID:[968911] 9114MB)260622-10:39:11 (UTC+8)
30103CUDA0: 11GB / 48GB 76% || CUDA1: 9GB / 48GB 32% [双卡负载] (高占用进程: CUDA0 PID:[856768] 9150MB | CUDA1 PID:[968911] 9120MB)260622-10:37:36 (UTC+8)
30102CUDA0: 11GB / 48GB 86% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[856768] 9172MB)260622-10:36:01 (UTC+8)
30101CUDA0: 11GB / 48GB 84% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[856768] 9146MB)260622-10:34:26 (UTC+8)
30100CUDA0: 11GB / 48GB 84% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[856768] 9146MB)260622-10:32:51 (UTC+8)
30099CUDA0: 11GB / 48GB 83% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[856768] 9094MB)260622-10:31:15 (UTC+8)
30098CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[732529] 6692MB)260622-10:29:40 (UTC+8)
30097CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[732529] 6692MB)260622-10:28:05 (UTC+8)
30096CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[732529] 6692MB)260622-10:26:31 (UTC+8)
30095CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 83% [双卡负载] (高占用进程: CUDA1 PID:[732529] 6692MB)260622-10:24:56 (UTC+8)
30094CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 83% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:23:21 (UTC+8)
30093CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:21:46 (UTC+8)
30092CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:20:11 (UTC+8)
30091CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:18:36 (UTC+8)
30090CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:17:02 (UTC+8)
30089CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 96% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:15:27 (UTC+8)
30088CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[538488] 6692MB)260622-10:13:52 (UTC+8)
30087CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 80% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:12:17 (UTC+8)
30086CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:10:43 (UTC+8)
30085CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 82% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:09:08 (UTC+8)
30084CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:07:33 (UTC+8)
30083CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 84% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:05:58 (UTC+8)
30082CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:04:23 (UTC+8)
30081CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:02:48 (UTC+8)
30080CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-10:01:13 (UTC+8)
30079CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-09:59:38 (UTC+8)
30078CUDA0: 2GB / 48GB 7% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6782MB)260622-09:58:04 (UTC+8)
30077CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 85% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6692MB)260622-09:54:50 (UTC+8)
30076CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6692MB)260622-09:53:15 (UTC+8)
30075CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6692MB)260622-09:51:41 (UTC+8)
30074CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[83105] 6692MB)260622-09:50:06 (UTC+8)
30073CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:48:31 (UTC+8)
30072CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6784MB)260622-09:46:56 (UTC+8)
30071CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6784MB)260622-09:45:21 (UTC+8)
30070CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 79% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6784MB)260622-09:43:46 (UTC+8)
30069CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6784MB)260622-09:42:12 (UTC+8)
30068CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6784MB)260622-09:40:37 (UTC+8)
30067CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6782MB)260622-09:39:02 (UTC+8)
30066CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6782MB)260622-09:37:27 (UTC+8)
30065CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 84% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6782MB)260622-09:35:52 (UTC+8)
30064CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6782MB)260622-09:32:38 (UTC+8)
30063CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6692MB)260622-09:31:03 (UTC+8)
30062CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6692MB)260622-09:29:29 (UTC+8)
30061CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6692MB)260622-09:27:54 (UTC+8)
30060CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6692MB)260622-09:26:19 (UTC+8)
30059CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3826983] 6692MB)260622-09:24:45 (UTC+8)
30058CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:23:10 (UTC+8)
30057CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:21:35 (UTC+8)
30056CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:20:00 (UTC+8)
30055CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:18:25 (UTC+8)
30054CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:16:50 (UTC+8)
30053CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:15:15 (UTC+8)
30052CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:13:40 (UTC+8)
30051CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:12:06 (UTC+8)
30050CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:10:31 (UTC+8)
30049CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:08:56 (UTC+8)
30048CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:07:21 (UTC+8)
30047CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:05:46 (UTC+8)
30046CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:04:12 (UTC+8)
30045CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:02:37 (UTC+8)
30044CUDA0: 2GB / 48GB 9% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-09:01:02 (UTC+8)
30043CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:59:27 (UTC+8)
30042CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:57:52 (UTC+8)
30041CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:56:17 (UTC+8)
30040CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:54:42 (UTC+8)
30039CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:53:07 (UTC+8)
30038CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:51:32 (UTC+8)
30037CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:49:57 (UTC+8)
30036CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:48:23 (UTC+8)
30035CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:46:48 (UTC+8)
30034CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:45:13 (UTC+8)
30033CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:43:38 (UTC+8)
30032CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:42:03 (UTC+8)
30031CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:40:28 (UTC+8)
30030CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:38:54 (UTC+8)
30029CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:37:19 (UTC+8)
30028CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3095062] 6684MB)260622-08:35:44 (UTC+8)
30027CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3095062] 6684MB)260622-08:34:09 (UTC+8)
30026CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3095062] 6684MB)260622-08:32:34 (UTC+8)
30025CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3095062] 6684MB)260622-08:29:20 (UTC+8)
30024CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[3095062] 6684MB)260622-08:27:45 (UTC+8)
30023CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[3095062] 6684MB)260622-08:26:10 (UTC+8)
30022CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3067653] 6692MB)260622-08:24:35 (UTC+8)
30021CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3067653] 6692MB)260622-08:23:00 (UTC+8)
30020CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[3067653] 6692MB)260622-08:21:25 (UTC+8)
30019CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[3067653] 6692MB)260622-08:19:51 (UTC+8)
30018CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 81% [双卡负载] (高占用进程: CUDA1 PID:[3067653] 6692MB)260622-08:18:16 (UTC+8)
30017CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:16:41 (UTC+8)
30016CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[3043662] 6692MB)260622-08:15:06 (UTC+8)
30015CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3043662] 6692MB)260622-08:13:31 (UTC+8)
30014CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3043662] 6692MB)260622-08:11:56 (UTC+8)
30013CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3043662] 6692MB)260622-08:10:21 (UTC+8)
30012CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[3043662] 6692MB)260622-08:08:46 (UTC+8)
30011CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:07:12 (UTC+8)
30010CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:05:37 (UTC+8)
30009CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:04:02 (UTC+8)
30008CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:02:26 (UTC+8)
30007CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-08:00:52 (UTC+8)
30006CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:59:17 (UTC+8)
30005CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:57:42 (UTC+8)
30004CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:56:07 (UTC+8)
30003CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:54:32 (UTC+8)
30002CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:52:57 (UTC+8)
30001CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:51:22 (UTC+8)
30000CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:49:47 (UTC+8)
29999CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:48:13 (UTC+8)
29998CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:46:38 (UTC+8)
29997CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:45:03 (UTC+8)
29996CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:43:28 (UTC+8)
29995CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:41:53 (UTC+8)
29994CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:40:18 (UTC+8)
29993CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:38:43 (UTC+8)
29992CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:37:09 (UTC+8)
29991CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:35:34 (UTC+8)
29990CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:32:20 (UTC+8)
29989CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:30:45 (UTC+8)
29988CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:27:31 (UTC+8)
29987CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:24:17 (UTC+8)
29986CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:22:42 (UTC+8)
29985CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:21:07 (UTC+8)
29984CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:19:32 (UTC+8)
29983CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:17:58 (UTC+8)
29982CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:16:23 (UTC+8)
29981CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:14:48 (UTC+8)
29980CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:13:13 (UTC+8)
29979CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:11:39 (UTC+8)
29978CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:10:04 (UTC+8)
29977CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:08:29 (UTC+8)
29976CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:06:54 (UTC+8)
29975CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:05:20 (UTC+8)
29974CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:03:45 (UTC+8)
29973CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:02:10 (UTC+8)
29972CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-07:00:35 (UTC+8)
29971CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:59:00 (UTC+8)
29970CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:57:26 (UTC+8)
29969CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:55:51 (UTC+8)
29968CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:54:16 (UTC+8)
29967CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:52:41 (UTC+8)
29966CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:51:06 (UTC+8)
29965CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:49:31 (UTC+8)
29964CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:47:56 (UTC+8)
29963CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:46:21 (UTC+8)
29962CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:44:46 (UTC+8)
29961CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:43:11 (UTC+8)
29960CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:41:36 (UTC+8)
29959CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:40:02 (UTC+8)
29958CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:38:27 (UTC+8)
29957CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:36:53 (UTC+8)
29956CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:35:18 (UTC+8)
29955CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:33:43 (UTC+8)
29954CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:32:08 (UTC+8)
29953CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:30:33 (UTC+8)
29952CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:28:59 (UTC+8)
29951CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:27:24 (UTC+8)
29950CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:25:49 (UTC+8)
29949CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:24:14 (UTC+8)
29948CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:22:39 (UTC+8)
29947CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-06:21:05 (UTC+8)
29946CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:19:30 (UTC+8)
29945CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:17:55 (UTC+8)
29944CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:16:20 (UTC+8)
29943CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 83% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:14:45 (UTC+8)
29942CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 85% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:13:10 (UTC+8)
29941CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:11:35 (UTC+8)
29940CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2627949] 6692MB)260622-06:10:00 (UTC+8)
29939CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-06:06:46 (UTC+8)
29938CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 97% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-06:05:12 (UTC+8)
29937CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-06:03:37 (UTC+8)
29936CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 94% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-06:02:02 (UTC+8)
29935CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-06:00:27 (UTC+8)
29934CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-05:58:52 (UTC+8)
29933CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[2591386] 6698MB)260622-05:57:17 (UTC+8)
29932CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:55:42 (UTC+8)
29931CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[2565455] 6698MB)260622-05:54:07 (UTC+8)
29930CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 82% [双卡负载] (高占用进程: CUDA1 PID:[2565455] 6698MB)260622-05:52:33 (UTC+8)
29929CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2565455] 6698MB)260622-05:50:58 (UTC+8)
29928CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 96% [双卡负载] (高占用进程: CUDA1 PID:[2565455] 6698MB)260622-05:49:23 (UTC+8)
29927CUDA0: 2GB / 48GB 0% || CUDA1: 7GB / 48GB 81% [双卡负载] (高占用进程: CUDA1 PID:[2565455] 6698MB)260622-05:47:48 (UTC+8)
29926CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:46:13 (UTC+8)
29925CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:44:38 (UTC+8)
29924CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:43:03 (UTC+8)
29923CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:41:29 (UTC+8)
29922CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:39:54 (UTC+8)
29921CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:38:19 (UTC+8)
29920CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:36:44 (UTC+8)
29919CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:35:09 (UTC+8)
29918CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:33:34 (UTC+8)
29917CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:32:00 (UTC+8)
29916CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:30:25 (UTC+8)
29915CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:28:50 (UTC+8)
29914CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:27:15 (UTC+8)
29913CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-05:25:40 (UTC+8)
29912CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32796MB)260622-05:24:05 (UTC+8)
29911CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32796MB)260622-05:22:30 (UTC+8)
29910CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32796MB)260622-05:20:56 (UTC+8)
29909CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32796MB)260622-05:19:21 (UTC+8)
29908CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32796MB)260622-05:17:46 (UTC+8)
29907CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32796MB)260622-05:16:11 (UTC+8)
29906CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 40576MB)260622-05:14:36 (UTC+8)
29905CUDA0: 2GB / 48GB 0% || CUDA1: 14GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 14682MB)260622-05:13:01 (UTC+8)
29904CUDA0: 2GB / 48GB 0% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 27616MB)260622-05:11:26 (UTC+8)
29903CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 36596MB)260622-05:09:51 (UTC+8)
29902CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 48236MB)260622-05:08:17 (UTC+8)
29901CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 25474MB)260622-05:06:42 (UTC+8)
29900CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 38376MB)260622-05:05:08 (UTC+8)
29899CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 47776MB)260622-05:03:33 (UTC+8)
29898CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 20918MB)260622-05:01:58 (UTC+8)
29897CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 28956MB)260622-05:00:23 (UTC+8)
29896CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 36778MB)260622-04:58:48 (UTC+8)
29895CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 47216MB)260622-04:57:14 (UTC+8)
29894CUDA0: 2GB / 48GB 0% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 23796MB)260622-04:55:39 (UTC+8)
29893CUDA0: 2GB / 48GB 0% || CUDA1: 31GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 32116MB)260622-04:54:04 (UTC+8)
29892CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 44118MB)260622-04:52:29 (UTC+8)
29891CUDA0: 2GB / 48GB 0% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2399179] 16150MB)260622-04:50:54 (UTC+8)
29890CUDA0: 2GB / 48GB 0% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 26410MB)260622-04:49:19 (UTC+8)
29889CUDA0: 2GB / 48GB 0% || CUDA1: 26GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 26410MB)260622-04:47:44 (UTC+8)
29888CUDA0: 2GB / 48GB 0% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 26410MB)260622-04:46:10 (UTC+8)
29887CUDA0: 2GB / 48GB 0% || CUDA1: 13GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 13290MB)260622-04:44:35 (UTC+8)
29886CUDA0: 2GB / 48GB 0% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 11130MB)260622-04:43:00 (UTC+8)
29885CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 25536MB)260622-04:41:25 (UTC+8)
29884CUDA0: 2GB / 48GB 0% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 35680MB)260622-04:39:51 (UTC+8)
29883CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 46876MB)260622-04:38:16 (UTC+8)
29882CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 20496MB)260622-04:36:41 (UTC+8)
29881CUDA0: 2GB / 48GB 0% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 33556MB)260622-04:35:06 (UTC+8)
29880CUDA0: 2GB / 48GB 0% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 41936MB)260622-04:33:31 (UTC+8)
29879CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 25276MB)260622-04:30:17 (UTC+8)
29878CUDA0: 2GB / 48GB 0% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 36156MB)260622-04:28:43 (UTC+8)
29877CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 47838MB)260622-04:27:08 (UTC+8)
29876CUDA0: 2GB / 48GB 0% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 23576MB)260622-04:25:33 (UTC+8)
29875CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 46416MB)260622-04:22:19 (UTC+8)
29874CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 20336MB)260622-04:20:44 (UTC+8)
29873CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2303949] 32758MB)260622-04:19:09 (UTC+8)
29872CUDA0: 2GB / 48GB 0% || CUDA1: 0GB / 48GB 0% [单卡负载]260622-04:17:34 (UTC+8)
29871CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:15:59 (UTC+8)
29870CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:14:25 (UTC+8)
29869CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:12:50 (UTC+8)
29868CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:11:15 (UTC+8)
29867CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:09:40 (UTC+8)
29866CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:08:06 (UTC+8)
29865CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:06:31 (UTC+8)
29864CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:04:56 (UTC+8)
29863CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:03:21 (UTC+8)
29862CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:01:47 (UTC+8)
29861CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 95% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 32318MB)260622-04:00:12 (UTC+8)
29860CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 31018MB)260622-03:58:37 (UTC+8)
29859CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 31018MB)260622-03:57:02 (UTC+8)
29858CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 31018MB)260622-03:55:27 (UTC+8)
29857CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 31016MB)260622-03:53:52 (UTC+8)
29856CUDA0: 2GB / 48GB 0% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 29396MB)260622-03:52:18 (UTC+8)
29855CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 20096MB)260622-03:50:43 (UTC+8)
29854CUDA0: 2GB / 48GB 0% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 11328MB)260622-03:49:09 (UTC+8)
29853CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 25138MB)260622-03:47:34 (UTC+8)
29852CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 37136MB)260622-03:45:59 (UTC+8)
29851CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2205430] 47096MB)260622-03:44:24 (UTC+8)
29850CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 47916MB)260622-03:41:10 (UTC+8)
29849CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 47916MB)260622-03:39:35 (UTC+8)
29848CUDA0: 2GB / 48GB 12% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 47916MB)260622-03:38:00 (UTC+8)
29847CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 47376MB)260622-03:36:26 (UTC+8)
29846CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 47376MB)260622-03:34:51 (UTC+8)
29845CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 47376MB)260622-03:33:16 (UTC+8)
29844CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 46456MB)260622-03:31:41 (UTC+8)
29843CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 46558MB)260622-03:28:27 (UTC+8)
29842CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 22936MB)260622-03:26:52 (UTC+8)
29841CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 31196MB)260622-03:25:18 (UTC+8)
29840CUDA0: 2GB / 48GB 0% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 42376MB)260622-03:23:43 (UTC+8)
29839CUDA0: 2GB / 48GB 0% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 21496MB)260622-03:20:29 (UTC+8)
29838CUDA0: 2GB / 48GB 0% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 29696MB)260622-03:18:54 (UTC+8)
29837CUDA0: 2GB / 48GB 0% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 41956MB)260622-03:17:19 (UTC+8)
29836CUDA0: 2GB / 48GB 0% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 46876MB)260622-03:15:44 (UTC+8)
29835CUDA0: 2GB / 48GB 0% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 19874MB)260622-03:14:09 (UTC+8)
29834CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 29056MB)260622-03:12:35 (UTC+8)
29833CUDA0: 2GB / 48GB 0% || CUDA1: 38GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 39100MB)260622-03:11:00 (UTC+8)
29832CUDA0: 2GB / 48GB 0% || CUDA1: 11GB / 48GB 84% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 11476MB)260622-03:09:25 (UTC+8)
29831CUDA0: 2GB / 48GB 0% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2106653] 23096MB)260622-03:07:50 (UTC+8)
29830CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 0% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 40976MB)260622-03:06:15 (UTC+8)
29829CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 92% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 40976MB)260622-03:04:41 (UTC+8)
29828CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 92% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 40976MB)260622-03:01:27 (UTC+8)
29827CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 40976MB)260622-02:59:53 (UTC+8)
29826CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 40976MB)260622-02:58:18 (UTC+8)
29825CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 40976MB)260622-02:56:43 (UTC+8)
29824CUDA0: 2GB / 48GB 0% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 38476MB)260622-02:55:08 (UTC+8)
29823CUDA0: 2GB / 48GB 0% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 17744MB)260622-02:53:33 (UTC+8)
29822CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 28996MB)260622-02:51:59 (UTC+8)
29821CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 41076MB)260622-02:50:24 (UTC+8)
29820CUDA0: 2GB / 48GB 0% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 11104MB)260622-02:48:49 (UTC+8)
29819CUDA0: 2GB / 48GB 0% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 24536MB)260622-02:47:14 (UTC+8)
29818CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 36836MB)260622-02:45:39 (UTC+8)
29817CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 47976MB)260622-02:44:04 (UTC+8)
29816CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 22136MB)260622-02:42:29 (UTC+8)
29815CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 32836MB)260622-02:40:54 (UTC+8)
29814CUDA0: 2GB / 48GB 0% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 41456MB)260622-02:39:20 (UTC+8)
29813CUDA0: 2GB / 48GB 0% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 15546MB)260622-02:37:45 (UTC+8)
29812CUDA0: 2GB / 48GB 0% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 24896MB)260622-02:36:10 (UTC+8)
29811CUDA0: 2GB / 48GB 0% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 36356MB)260622-02:34:36 (UTC+8)
29810CUDA0: 2GB / 48GB 9% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 46378MB)260622-02:33:01 (UTC+8)
29809CUDA0: 2GB / 48GB 0% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2008067] 18374MB)260622-02:31:26 (UTC+8)
29808CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 44978MB)260622-02:29:51 (UTC+8)
29807CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 44978MB)260622-02:28:16 (UTC+8)
29806CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 44978MB)260622-02:26:41 (UTC+8)
29805CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 44978MB)260622-02:25:06 (UTC+8)
29804CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 44978MB)260622-02:23:31 (UTC+8)
29803CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 43838MB)260622-02:21:56 (UTC+8)
29802CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 44618MB)260622-02:20:21 (UTC+8)
29801CUDA0: 2GB / 48GB 0% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 17440MB)260622-02:18:47 (UTC+8)
29800CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 30796MB)260622-02:17:12 (UTC+8)
29799CUDA0: 2GB / 48GB 0% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 38378MB)260622-02:15:37 (UTC+8)
29798CUDA0: 2GB / 48GB 0% || CUDA1: 13GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 12822MB)260622-02:14:02 (UTC+8)
29797CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 25376MB)260622-02:12:28 (UTC+8)
29796CUDA0: 2GB / 48GB 0% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 34916MB)260622-02:10:53 (UTC+8)
29795CUDA0: 2GB / 48GB 0% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 42298MB)260622-02:09:18 (UTC+8)
29794CUDA0: 2GB / 48GB 0% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 15736MB)260622-02:07:43 (UTC+8)
29793CUDA0: 2GB / 48GB 0% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 27978MB)260622-02:06:08 (UTC+8)
29792CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 37976MB)260622-02:04:33 (UTC+8)
29791CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 48358MB)260622-02:02:58 (UTC+8)
29790CUDA0: 2GB / 48GB 0% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 19376MB)260622-02:01:23 (UTC+8)
29789CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 29016MB)260622-01:59:48 (UTC+8)
29788CUDA0: 2GB / 48GB 0% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1910538] 38936MB)260622-01:58:13 (UTC+8)
29787CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 94% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 32876MB)260622-01:54:59 (UTC+8)
29786CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 32876MB)260622-01:53:24 (UTC+8)
29785CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 32876MB)260622-01:51:49 (UTC+8)
29784CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 32876MB)260622-01:50:15 (UTC+8)
29783CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 28756MB)260622-01:48:40 (UTC+8)
29782CUDA0: 2GB / 48GB 0% || CUDA1: 27GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 27716MB)260622-01:47:06 (UTC+8)
29781CUDA0: 2GB / 48GB 0% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 23676MB)260622-01:45:31 (UTC+8)
29780CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 28998MB)260622-01:43:56 (UTC+8)
29779CUDA0: 2GB / 48GB 0% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 41756MB)260622-01:42:21 (UTC+8)
29778CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 44798MB)260622-01:40:46 (UTC+8)
29777CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 44798MB)260622-01:39:11 (UTC+8)
29776CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 44798MB)260622-01:37:37 (UTC+8)
29775CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 44798MB)260622-01:36:02 (UTC+8)
29774CUDA0: 2GB / 48GB 0% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 43418MB)260622-01:34:27 (UTC+8)
29773CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 36796MB)260622-01:32:52 (UTC+8)
29772CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 36796MB)260622-01:31:17 (UTC+8)
29771CUDA0: 2GB / 48GB 0% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 34836MB)260622-01:29:42 (UTC+8)
29770CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 34% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 25576MB)260622-01:28:08 (UTC+8)
29769CUDA0: 2GB / 48GB 0% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 29578MB)260622-01:26:33 (UTC+8)
29768CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 39796MB)260622-01:24:59 (UTC+8)
29767CUDA0: 2GB / 48GB 0% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 16164MB)260622-01:23:24 (UTC+8)
29766CUDA0: 2GB / 48GB 0% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 27276MB)260622-01:21:49 (UTC+8)
29765CUDA0: 2GB / 48GB 0% || CUDA1: 9GB / 48GB 0% [双卡负载] (高占用进程: CUDA1 PID:[1803669] 9000MB)260622-01:20:15 (UTC+8)
29764CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 46296MB)260622-01:18:40 (UTC+8)
29763CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 46296MB)260622-01:17:05 (UTC+8)
29762CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 46296MB)260622-01:15:30 (UTC+8)
29761CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 46296MB)260622-01:13:55 (UTC+8)
29760CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 90% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 46296MB)260622-01:12:21 (UTC+8)
29759CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 45716MB)260622-01:10:46 (UTC+8)
29758CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 45176MB)260622-01:09:12 (UTC+8)
29757CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 45176MB)260622-01:07:37 (UTC+8)
29756CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 86% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 44596MB)260622-01:06:02 (UTC+8)
29755CUDA0: 2GB / 48GB 0% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 43176MB)260622-01:04:27 (UTC+8)
29754CUDA0: 2GB / 48GB 0% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 17576MB)260622-01:02:52 (UTC+8)
29753CUDA0: 2GB / 48GB 0% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 31278MB)260622-01:01:17 (UTC+8)
29752CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 40236MB)260622-00:59:42 (UTC+8)
29751CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 93% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 19060MB)260622-00:58:07 (UTC+8)
29750CUDA0: 2GB / 48GB 0% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 24096MB)260622-00:56:32 (UTC+8)
29749CUDA0: 2GB / 48GB 0% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 35656MB)260622-00:54:58 (UTC+8)
29748CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 46456MB)260622-00:53:23 (UTC+8)
29747CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 22576MB)260622-00:50:09 (UTC+8)
29746CUDA0: 2GB / 48GB 0% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 31956MB)260622-00:48:34 (UTC+8)
29745CUDA0: 2GB / 48GB 0% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 41436MB)260622-00:47:00 (UTC+8)
29744CUDA0: 2GB / 48GB 0% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 15262MB)260622-00:45:25 (UTC+8)
29743CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 28156MB)260622-00:43:50 (UTC+8)
29742CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 36616MB)260622-00:42:15 (UTC+8)
29741CUDA0: 2GB / 48GB 0% || CUDA1: 12GB / 48GB 0% [双卡负载] (高占用进程: CUDA1 PID:[1690584] 12572MB)260622-00:40:40 (UTC+8)
29740CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 37456MB)260622-00:39:05 (UTC+8)
29739CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 37456MB)260622-00:37:31 (UTC+8)
29738CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 37456MB)260622-00:35:56 (UTC+8)
29737CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 92% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 37456MB)260622-00:34:21 (UTC+8)
29736CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 37456MB)260622-00:32:46 (UTC+8)
29735CUDA0: 2GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 30956MB)260622-00:31:11 (UTC+8)
29734CUDA0: 2GB / 48GB 0% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 28996MB)260622-00:29:37 (UTC+8)
29733CUDA0: 2GB / 48GB 0% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 35856MB)260622-00:28:02 (UTC+8)
29732CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 46096MB)260622-00:26:27 (UTC+8)
29731CUDA0: 2GB / 48GB 0% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 20636MB)260622-00:24:52 (UTC+8)
29730CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 32656MB)260622-00:23:17 (UTC+8)
29729CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 45158MB)260622-00:21:43 (UTC+8)
29728CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 20196MB)260622-00:20:08 (UTC+8)
29727CUDA0: 2GB / 48GB 0% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 33456MB)260622-00:18:33 (UTC+8)
29726CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 45256MB)260622-00:16:58 (UTC+8)
29725CUDA0: 2GB / 48GB 0% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 20016MB)260622-00:15:23 (UTC+8)
29724CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 32496MB)260622-00:13:48 (UTC+8)
29723CUDA0: 2GB / 48GB 0% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 44576MB)260622-00:12:13 (UTC+8)
29722CUDA0: 2GB / 48GB 0% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 18754MB)260622-00:10:38 (UTC+8)
29721CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 32696MB)260622-00:09:03 (UTC+8)
29720CUDA0: 2GB / 48GB 0% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 42756MB)260622-00:07:28 (UTC+8)
29719CUDA0: 2GB / 48GB 0% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 17964MB)260622-00:05:54 (UTC+8)
29718CUDA0: 2GB / 48GB 0% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1587356] 29556MB)260622-00:04:19 (UTC+8)
29717CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 39576MB)260622-00:02:44 (UTC+8)
29716CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 39576MB)260622-00:01:09 (UTC+8)
29715CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 89% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 39576MB)260621-23:59:35 (UTC+8)
29714CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 39496MB)260621-23:58:00 (UTC+8)
29713CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 39496MB)260621-23:56:25 (UTC+8)
29712CUDA0: 2GB / 48GB 0% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 27396MB)260621-23:54:50 (UTC+8)
29711CUDA0: 2GB / 48GB 0% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 40476MB)260621-23:53:15 (UTC+8)
29710CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 48098MB)260621-23:51:41 (UTC+8)
29709CUDA0: 2GB / 48GB 0% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 24374MB)260621-23:50:06 (UTC+8)
29708CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 37876MB)260621-23:48:32 (UTC+8)
29707CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 48378MB)260621-23:46:57 (UTC+8)
29706CUDA0: 2GB / 48GB 0% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 21396MB)260621-23:45:22 (UTC+8)
29705CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 91% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 32816MB)260621-23:43:47 (UTC+8)
29704CUDA0: 2GB / 48GB 0% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 39278MB | CUDA1 PID:[1390427] 6682MB)260621-23:42:12 (UTC+8)
29703CUDA0: 2GB / 48GB 0% || CUDA1: 29GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 22636MB | CUDA1 PID:[1390427] 6682MB)260621-23:40:37 (UTC+8)
29702CUDA0: 2GB / 48GB 0% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 33018MB | CUDA1 PID:[1390427] 6682MB)260621-23:39:02 (UTC+8)
29701CUDA0: 2GB / 48GB 0% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 14904MB | CUDA1 PID:[1390427] 6682MB)260621-23:37:27 (UTC+8)
29700CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 30476MB | CUDA1 PID:[1390427] 6682MB)260621-23:35:52 (UTC+8)
29699CUDA0: 2GB / 48GB 0% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 37196MB | CUDA1 PID:[1390427] 6682MB)260621-23:34:18 (UTC+8)
29698CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 19004MB | CUDA1 PID:[1390427] 6682MB)260621-23:32:43 (UTC+8)
29697CUDA0: 2GB / 48GB 0% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 27476MB | CUDA1 PID:[1390427] 6682MB)260621-23:31:08 (UTC+8)
29696CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 16024MB | CUDA1 PID:[1390427] 6682MB)260621-23:29:33 (UTC+8)
29695CUDA0: 2GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 31496MB | CUDA1 PID:[1390427] 6682MB)260621-23:27:58 (UTC+8)
29694CUDA0: 2GB / 48GB 0% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 19094MB | CUDA1 PID:[1390427] 6682MB)260621-23:26:23 (UTC+8)
29693CUDA0: 2GB / 48GB 0% || CUDA1: 15GB / 48GB 94% [双卡负载] (高占用进程: CUDA1 PID:[1474861] 9000MB | CUDA1 PID:[1390427] 6682MB)260621-23:24:48 (UTC+8)
29692CUDA0: 2GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:23:13 (UTC+8)
29691CUDA0: 40GB / 48GB 95% || CUDA1: 32GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1448800] 41558MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:21:38 (UTC+8)
29690CUDA0: 6GB / 48GB 93% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1448800] 3198MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:20:04 (UTC+8)
29689CUDA0: 26GB / 48GB 98% || CUDA1: 32GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1448800] 25138MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:18:29 (UTC+8)
29688CUDA0: 15GB / 48GB 96% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1435212] 16418MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:16:54 (UTC+8)
29687CUDA0: 44GB / 48GB 92% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1435212] 42658MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:15:19 (UTC+8)
29686CUDA0: 25GB / 48GB 99% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1435212] 23998MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:13:44 (UTC+8)
29685CUDA0: 46GB / 48GB 98% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1421700] 44978MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:12:09 (UTC+8)
29684CUDA0: 47GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1421700] 46482MB | CUDA1 PID:[1316526] 26158MB | CUDA1 PID:[1390427] 6682MB)260621-23:08:55 (UTC+8)
29683CUDA0: 24GB / 48GB 94% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1406253] 23058MB | CUDA1 PID:[1316526] 23518MB | CUDA1 PID:[1390427] 6682MB)260621-23:07:20 (UTC+8)
29682CUDA0: 39GB / 48GB 89% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1406253] 37298MB | CUDA1 PID:[1316526] 23518MB | CUDA1 PID:[1390427] 6682MB)260621-23:05:45 (UTC+8)
29681CUDA0: 17GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1406253] 15842MB | CUDA1 PID:[1316526] 23438MB | CUDA1 PID:[1390427] 6682MB)260621-23:04:11 (UTC+8)
29680CUDA0: 26GB / 48GB 90% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1393315] 23898MB | CUDA1 PID:[1316526] 23438MB | CUDA1 PID:[1390427] 6682MB)260621-23:02:36 (UTC+8)
29679CUDA0: 34GB / 48GB 98% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1393315] 34162MB | CUDA1 PID:[1316526] 16776MB | CUDA1 PID:[1390427] 6682MB)260621-22:59:22 (UTC+8)
29678CUDA0: 43GB / 48GB 96% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1379884] 42298MB | CUDA1 PID:[1316526] 41676MB)260621-22:57:47 (UTC+8)
29677CUDA0: 20GB / 48GB 92% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1379884] 20378MB | CUDA1 PID:[1316526] 23156MB | CUDA1 PID:[1294302] 6692MB)260621-22:56:12 (UTC+8)
29676CUDA0: 32GB / 48GB 99% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1379884] 30938MB | CUDA1 PID:[1316526] 37036MB | CUDA1 PID:[1294302] 6692MB)260621-22:54:38 (UTC+8)
29675CUDA0: 36GB / 48GB 92% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1372687] 37396MB | CUDA1 PID:[1316526] 18796MB | CUDA1 PID:[1294302] 6692MB)260621-22:53:03 (UTC+8)
29674CUDA0: 31GB / 48GB 93% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1372687] 28378MB | CUDA1 PID:[1316526] 31956MB | CUDA1 PID:[1294302] 6692MB)260621-22:51:28 (UTC+8)
29673CUDA0: 26GB / 48GB 95% || CUDA1: 21GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1360757] 24516MB | CUDA1 PID:[1316526] 14564MB | CUDA1 PID:[1294302] 6692MB)260621-22:49:53 (UTC+8)
29672CUDA0: 41GB / 48GB 93% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1360757] 38842MB | CUDA1 PID:[1316526] 29076MB | CUDA1 PID:[1294302] 6692MB)260621-22:48:18 (UTC+8)
29671CUDA0: 8GB / 48GB 93% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1347770] 5118MB | CUDA1 PID:[1316526] 41638MB | CUDA1 PID:[1294302] 6692MB)260621-22:46:43 (UTC+8)
29670CUDA0: 32GB / 48GB 94% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1347770] 33276MB | CUDA1 PID:[1316526] 25878MB | CUDA1 PID:[1294302] 6692MB)260621-22:45:09 (UTC+8)
29669CUDA0: 35GB / 48GB 97% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1347770] 36242MB | CUDA1 PID:[1316526] 40836MB | CUDA1 PID:[1294302] 6692MB)260621-22:43:34 (UTC+8)
29668CUDA0: 13GB / 48GB 92% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1334656] 14018MB | CUDA1 PID:[1316526] 30236MB | CUDA1 PID:[1294302] 6692MB)260621-22:41:59 (UTC+8)
29667CUDA0: 29GB / 48GB 93% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1334656] 26678MB | CUDA1 PID:[1316526] 18806MB | CUDA1 PID:[1294302] 6692MB)260621-22:40:24 (UTC+8)
29666CUDA0: 21GB / 48GB 93% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1334656] 18902MB | CUDA1 PID:[1316526] 38856MB | CUDA1 PID:[1294302] 6692MB)260621-22:38:49 (UTC+8)
29665CUDA0: 46GB / 48GB 93% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1321512] 44198MB | CUDA1 PID:[1316526] 26216MB | CUDA1 PID:[1294302] 6692MB)260621-22:37:15 (UTC+8)
29664CUDA0: 39GB / 48GB 93% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1321512] 37238MB | CUDA1 PID:[1316526] 14976MB | CUDA1 PID:[1294302] 6692MB)260621-22:35:40 (UTC+8)
29663CUDA0: 21GB / 48GB 99% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1321512] 19682MB | CUDA1 PID:[1316526] 33376MB | CUDA1 PID:[1294302] 6692MB)260621-22:34:06 (UTC+8)
29662CUDA0: 35GB / 48GB 94% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1314544] 35916MB | CUDA1 PID:[1316526] 15734MB | CUDA1 PID:[1294302] 6692MB)260621-22:32:31 (UTC+8)
29661CUDA0: 26GB / 48GB 94% || CUDA1: 31GB / 48GB 84% [双卡负载] (高占用进程: CUDA0 PID:[1314544] 26598MB | CUDA1 PID:[1190241] 24970MB | CUDA1 PID:[1294302] 6692MB)260621-22:30:56 (UTC+8)
29660CUDA0: 46GB / 48GB 96% || CUDA1: 31GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1308040] 44558MB | CUDA1 PID:[1190241] 24810MB | CUDA1 PID:[1294302] 6692MB)260621-22:29:21 (UTC+8)
29659CUDA0: 44GB / 48GB 96% || CUDA1: 30GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1300737] 42436MB | CUDA1 PID:[1190241] 24350MB | CUDA1 PID:[1294302] 6690MB)260621-22:27:47 (UTC+8)
29658CUDA0: 18GB / 48GB 93% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1300737] 15418MB | CUDA1 PID:[1190241] 24350MB | CUDA1 PID:[1294302] 6690MB)260621-22:26:12 (UTC+8)
29657CUDA0: 13GB / 48GB 97% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1288339] 13896MB | CUDA1 PID:[1190241] 24350MB | CUDA1 PID:[1294302] 6690MB)260621-22:24:37 (UTC+8)
29656CUDA0: 15GB / 48GB 93% || CUDA1: 15GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[1288339] 12758MB | CUDA1 PID:[1190241] 14930MB)260621-22:23:02 (UTC+8)
29655CUDA0: 15GB / 48GB 98% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1288339] 13238MB | CUDA1 PID:[1190241] 11110MB | CUDA1 PID:[1193906] 6690MB)260621-22:21:28 (UTC+8)
29654CUDA0: 10GB / 48GB 92% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1276507] 7458MB | CUDA1 PID:[1190241] 23416MB | CUDA1 PID:[1193906] 6690MB)260621-22:19:53 (UTC+8)
29653CUDA0: 10GB / 48GB 93% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1276507] 7398MB | CUDA1 PID:[1190241] 37776MB | CUDA1 PID:[1193906] 6690MB)260621-22:18:18 (UTC+8)
29652CUDA0: 27GB / 48GB 99% || CUDA1: 24GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1276507] 27558MB | CUDA1 PID:[1190241] 17644MB | CUDA1 PID:[1193906] 6690MB)260621-22:16:43 (UTC+8)
29651CUDA0: 15GB / 48GB 93% || CUDA1: 33GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1262020] 12998MB | CUDA1 PID:[1190241] 26838MB | CUDA1 PID:[1193906] 6690MB)260621-22:15:08 (UTC+8)
29650CUDA0: 43GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1262020] 42382MB | CUDA1 PID:[1190241] 41456MB | CUDA1 PID:[1193906] 6690MB)260621-22:13:33 (UTC+8)
29649CUDA0: 47GB / 48GB 99% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1262020] 46762MB | CUDA1 PID:[1190241] 24616MB | CUDA1 PID:[1193906] 6690MB)260621-22:11:58 (UTC+8)
29648CUDA0: 5GB / 48GB 91% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1249358] 4156MB | CUDA1 PID:[1190241] 37716MB | CUDA1 PID:[1193906] 6690MB)260621-22:10:24 (UTC+8)
29647CUDA0: 38GB / 48GB 91% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1249358] 35502MB | CUDA1 PID:[1190241] 25516MB | CUDA1 PID:[1193906] 6690MB)260621-22:08:49 (UTC+8)
29646CUDA0: 14GB / 48GB 93% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1249358] 11162MB | CUDA1 PID:[1190241] 41256MB | CUDA1 PID:[1193906] 6690MB)260621-22:07:14 (UTC+8)
29645CUDA0: 17GB / 48GB 94% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1236568] 17916MB | CUDA1 PID:[1190241] 25996MB | CUDA1 PID:[1193906] 6690MB)260621-22:05:39 (UTC+8)
29644CUDA0: 16GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1236568] 15282MB | CUDA1 PID:[1190241] 29658MB | CUDA1 PID:[1193906] 6690MB)260621-22:02:25 (UTC+8)
29643CUDA0: 15GB / 48GB 97% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1224462] 13918MB | CUDA1 PID:[1190241] 16896MB | CUDA1 PID:[1193906] 6690MB)260621-22:00:50 (UTC+8)
29642CUDA0: 15GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1224462] 12358MB | CUDA1 PID:[1190241] 31218MB | CUDA1 PID:[1193906] 6690MB)260621-21:59:15 (UTC+8)
29641CUDA0: 33GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1224462] 31738MB | CUDA1 PID:[1190241] 16154MB | CUDA1 PID:[1193906] 6690MB)260621-21:57:40 (UTC+8)
29640CUDA0: 4GB / 48GB 93% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1216789] 2676MB | CUDA1 PID:[1190241] 32816MB | CUDA1 PID:[1193906] 6690MB)260621-21:56:06 (UTC+8)
29639CUDA0: 35GB / 48GB 95% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1204938] 34158MB | CUDA1 PID:[1190241] 19776MB | CUDA1 PID:[1193906] 6690MB)260621-21:54:31 (UTC+8)
29638CUDA0: 37GB / 48GB 89% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1204938] 35458MB | CUDA1 PID:[1190241] 35316MB | CUDA1 PID:[1193906] 6690MB)260621-21:52:56 (UTC+8)
29637CUDA0: 44GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1204938] 43222MB | CUDA1 PID:[1190241] 23336MB | CUDA1 PID:[1193906] 6690MB)260621-21:51:21 (UTC+8)
29636CUDA0: 47GB / 48GB 92% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1191760] 44998MB | CUDA1 PID:[1190241] 41336MB | CUDA1 PID:[1193906] 6690MB)260621-21:49:46 (UTC+8)
29635CUDA0: 17GB / 48GB 99% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1191760] 15562MB | CUDA1 PID:[1190241] 29216MB | CUDA1 PID:[1193906] 6690MB)260621-21:48:11 (UTC+8)
29634CUDA0: 17GB / 48GB 99% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1191760] 15482MB | CUDA1 PID:[1190241] 46676MB)260621-21:46:37 (UTC+8)
29633CUDA0: 24GB / 48GB 89% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1178860] 21478MB | CUDA1 PID:[1064417] 36160MB)260621-21:45:02 (UTC+8)
29632CUDA0: 31GB / 48GB 98% || CUDA1: 35GB / 48GB 90% [双卡负载] (高占用进程: CUDA0 PID:[1178860] 30302MB | CUDA1 PID:[1064417] 36160MB)260621-21:43:27 (UTC+8)
29631CUDA0: 35GB / 48GB 98% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1178860] 35182MB | CUDA1 PID:[1064417] 36160MB)260621-21:41:52 (UTC+8)
29630CUDA0: 10GB / 48GB 93% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1166069] 7296MB | CUDA1 PID:[1064417] 36160MB)260621-21:40:17 (UTC+8)
29629CUDA0: 14GB / 48GB 97% || CUDA1: 35GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[1166069] 13002MB | CUDA1 PID:[1064417] 36160MB)260621-21:38:42 (UTC+8)
29628CUDA0: 5GB / 48GB 93% || CUDA1: 35GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[1158908] 3616MB | CUDA1 PID:[1064417] 36160MB)260621-21:35:28 (UTC+8)
29627CUDA0: 2GB / 48GB 0% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:33:54 (UTC+8)
29626CUDA0: 21GB / 48GB 91% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1151584] 21596MB | CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:32:19 (UTC+8)
29625CUDA0: 18GB / 48GB 96% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1144566] 19336MB | CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:30:44 (UTC+8)
29624CUDA0: 28GB / 48GB 92% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1144566] 28378MB | CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:29:09 (UTC+8)
29623CUDA0: 2GB / 48GB 0% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:27:34 (UTC+8)
29622CUDA0: 3GB / 48GB 0% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:26:00 (UTC+8)
29621CUDA0: 9GB / 48GB 93% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1109612] 7440MB | CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:24:25 (UTC+8)
29620CUDA0: 34GB / 48GB 99% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1109612] 34702MB | CUDA1 PID:[1064417] 36160MB | CUDA1 PID:[1086319] 6682MB)260621-21:22:50 (UTC+8)
29619CUDA0: 45GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1109612] 44642MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:21:15 (UTC+8)
29618CUDA0: 34GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1109612] 33302MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:19:40 (UTC+8)
29617CUDA0: 33GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1109612] 32182MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:18:05 (UTC+8)
29616CUDA0: 18GB / 48GB 99% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1109612] 17942MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:16:30 (UTC+8)
29615CUDA0: 32GB / 48GB 0% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1081006] 30602MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:14:55 (UTC+8)
29614CUDA0: 40GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1081006] 38802MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:13:21 (UTC+8)
29613CUDA0: 26GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1081006] 25282MB | CUDA1 PID:[1064417] 25820MB | CUDA1 PID:[1086319] 6682MB)260621-21:11:46 (UTC+8)
29612CUDA0: 47GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1081006] 45842MB | CUDA1 PID:[1064417] 24140MB | CUDA1 PID:[1086319] 6682MB)260621-21:10:11 (UTC+8)
29611CUDA0: 35GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1081006] 33622MB | CUDA1 PID:[1064417] 24138MB | CUDA1 PID:[1086319] 6682MB)260621-21:08:36 (UTC+8)
29610CUDA0: 47GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1081006] 46502MB | CUDA1 PID:[1064417] 21856MB | CUDA1 PID:[1019803] 6690MB)260621-21:07:02 (UTC+8)
29609CUDA0: 8GB / 48GB 92% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1052387] 6344MB | CUDA1 PID:[1064417] 32218MB | CUDA1 PID:[1019803] 6690MB)260621-21:03:48 (UTC+8)
29608CUDA0: 45GB / 48GB 99% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1052387] 44084MB | CUDA1 PID:[1064417] 20216MB | CUDA1 PID:[1019803] 6690MB)260621-21:02:14 (UTC+8)
29607CUDA0: 42GB / 48GB 96% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1052387] 40104MB | CUDA1 PID:[1064417] 35796MB | CUDA1 PID:[1019803] 6690MB)260621-21:00:39 (UTC+8)
29606CUDA0: 26GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1052387] 25804MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:59:04 (UTC+8)
29605CUDA0: 46GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1052387] 45604MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:57:29 (UTC+8)
29604CUDA0: 41GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1052387] 41744MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:55:54 (UTC+8)
29603CUDA0: 3GB / 48GB 70% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:54:19 (UTC+8)
29602CUDA0: 20GB / 48GB 98% || CUDA1: 47GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1024752] 19824MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:52:44 (UTC+8)
29601CUDA0: 22GB / 48GB 93% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1024752] 20164MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:51:09 (UTC+8)
29600CUDA0: 18GB / 48GB 99% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1024752] 16944MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:47:55 (UTC+8)
29599CUDA0: 14GB / 48GB 97% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1024752] 12624MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:46:21 (UTC+8)
29598CUDA0: 2GB / 48GB 0% || CUDA1: 47GB / 48GB 95% [双卡负载] (高占用进程: CUDA1 PID:[918986] 40998MB | CUDA1 PID:[1019803] 6690MB)260621-20:44:46 (UTC+8)
29597CUDA0: 21GB / 48GB 92% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[994423] 18924MB | CUDA1 PID:[918986] 40998MB)260621-20:43:11 (UTC+8)
29596CUDA0: 34GB / 48GB 97% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[994423] 33024MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:41:36 (UTC+8)
29595CUDA0: 26GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[994423] 25364MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:40:01 (UTC+8)
29594CUDA0: 11GB / 48GB 93% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[994423] 8664MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:38:26 (UTC+8)
29593CUDA0: 11GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[994423] 10744MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:36:52 (UTC+8)
29592CUDA0: 35GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[994423] 33804MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:35:17 (UTC+8)
29591CUDA0: 32GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[964556] 30602MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:33:42 (UTC+8)
29590CUDA0: 39GB / 48GB 99% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[964556] 38042MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:32:07 (UTC+8)
29589CUDA0: 29GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[964556] 27822MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:30:32 (UTC+8)
29588CUDA0: 8GB / 48GB 95% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[964556] 7360MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:28:58 (UTC+8)
29587CUDA0: 45GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[964556] 43482MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:27:23 (UTC+8)
29586CUDA0: 47GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[964556] 46142MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:25:48 (UTC+8)
29585CUDA0: 3GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:24:13 (UTC+8)
29584CUDA0: 19GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[935636] 20124MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:22:39 (UTC+8)
29583CUDA0: 44GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[935636] 44704MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:21:04 (UTC+8)
29582CUDA0: 37GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[935636] 37784MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:19:29 (UTC+8)
29581CUDA0: 21GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[935636] 20864MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:17:54 (UTC+8)
29580CUDA0: 42GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[935636] 41684MB | CUDA1 PID:[918986] 40998MB | CUDA1 PID:[939224] 6690MB)260621-20:16:19 (UTC+8)
29579CUDA0: 9GB / 48GB 98% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[935636] 8604MB | CUDA1 PID:[918986] 33778MB)260621-20:14:45 (UTC+8)
29578CUDA0: 3GB / 48GB 0% || CUDA1: 33GB / 48GB 98% [双卡负载] (高占用进程: CUDA1 PID:[918986] 33778MB)260621-20:13:10 (UTC+8)
29577CUDA0: 6GB / 48GB 93% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[910523] 5324MB | CUDA1 PID:[918986] 33778MB)260621-20:11:35 (UTC+8)
29576CUDA0: 47GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[910523] 46444MB | CUDA1 PID:[918986] 23376MB)260621-20:10:00 (UTC+8)
29575CUDA0: 40GB / 48GB 100% || CUDA1: 12GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[910523] 39144MB | CUDA1 PID:[918986] 12250MB)260621-20:08:26 (UTC+8)
29574CUDA0: 14GB / 48GB 98% || CUDA1: 30GB / 48GB 88% [双卡负载] (高占用进程: CUDA0 PID:[910523] 12904MB | CUDA1 PID:[580625] 30418MB)260621-20:06:51 (UTC+8)
29573CUDA0: 20GB / 48GB 98% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[824979] 20684MB | CUDA1 PID:[580625] 30418MB)260621-20:03:37 (UTC+8)
29572CUDA0: 38GB / 48GB 93% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[824979] 35704MB | CUDA1 PID:[580625] 30418MB)260621-20:02:03 (UTC+8)
29571CUDA0: 13GB / 48GB 100% || CUDA1: 30GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[824979] 13524MB | CUDA1 PID:[580625] 30418MB)260621-20:00:28 (UTC+8)
29570CUDA0: 38GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[824979] 37464MB | CUDA1 PID:[580625] 30418MB)260621-19:58:53 (UTC+8)
29569CUDA0: 20GB / 48GB 87% || CUDA1: 30GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[824979] 17404MB | CUDA1 PID:[580625] 30418MB)260621-19:57:18 (UTC+8)
29568CUDA0: 16GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[824979] 14844MB | CUDA1 PID:[580625] 30418MB)260621-19:55:42 (UTC+8)
29567CUDA0: 3GB / 48GB 0% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[580625] 30418MB)260621-19:54:08 (UTC+8)
29566CUDA0: 43GB / 48GB 99% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[718704] 42484MB | CUDA1 PID:[580625] 30418MB)260621-19:52:33 (UTC+8)
29565CUDA0: 15GB / 48GB 97% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[718704] 14444MB | CUDA1 PID:[580625] 23798MB)260621-19:50:58 (UTC+8)
29564CUDA0: 45GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[718704] 45584MB | CUDA1 PID:[580625] 38776MB)260621-19:49:23 (UTC+8)
29563CUDA0: 28GB / 48GB 100% || CUDA1: 13GB / 48GB 88% [双卡负载] (高占用进程: CUDA0 PID:[718704] 27924MB | CUDA1 PID:[580625] 12824MB)260621-19:47:48 (UTC+8)
29562CUDA0: 34GB / 48GB 93% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[718704] 32124MB | CUDA1 PID:[580625] 25636MB)260621-19:46:13 (UTC+8)
29561CUDA0: 15GB / 48GB 93% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[718704] 12244MB | CUDA1 PID:[580625] 38436MB)260621-19:44:38 (UTC+8)
29560CUDA0: 15GB / 48GB 92% || CUDA1: 32GB / 48GB 88% [双卡负载] (高占用进程: CUDA0 PID:[611959] 12924MB | CUDA1 PID:[580625] 32056MB)260621-19:43:03 (UTC+8)
29559CUDA0: 29GB / 48GB 99% || CUDA1: 26GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[611959] 28144MB | CUDA1 PID:[580625] 26616MB)260621-19:41:29 (UTC+8)
29558CUDA0: 16GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[611959] 15804MB | CUDA1 PID:[580625] 37676MB)260621-19:39:54 (UTC+8)
29557CUDA0: 30GB / 48GB 93% || CUDA1: 20GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[611959] 27984MB | CUDA1 PID:[580625] 19560MB)260621-19:38:19 (UTC+8)
29556CUDA0: 19GB / 48GB 93% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[611959] 16184MB | CUDA1 PID:[580625] 23838MB)260621-19:36:44 (UTC+8)
29555CUDA0: 29GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[611959] 28664MB | CUDA1 PID:[580625] 37196MB)260621-19:35:09 (UTC+8)
29554CUDA0: 4GB / 48GB 0% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601949] 2178MB | CUDA1 PID:[580625] 48058MB)260621-19:33:35 (UTC+8)
29553CUDA0: 3GB / 48GB 0% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[580625] 21456MB)260621-19:32:00 (UTC+8)
29552CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[482150] 44424MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:30:25 (UTC+8)
29551CUDA0: 45GB / 48GB 97% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[482150] 43784MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:28:50 (UTC+8)
29550CUDA0: 25GB / 48GB 99% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[482150] 25124MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:27:15 (UTC+8)
29549CUDA0: 35GB / 48GB 98% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[482150] 35964MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:25:41 (UTC+8)
29548CUDA0: 12GB / 48GB 99% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[482150] 10824MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:24:06 (UTC+8)
29547CUDA0: 37GB / 48GB 98% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[482150] 36304MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:22:32 (UTC+8)
29546CUDA0: 12GB / 48GB 98% || CUDA1: 37GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[372849] 10744MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:20:57 (UTC+8)
29545CUDA0: 32GB / 48GB 93% || CUDA1: 37GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[372849] 29764MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:19:22 (UTC+8)
29544CUDA0: 32GB / 48GB 98% || CUDA1: 37GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[372849] 31264MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:17:47 (UTC+8)
29543CUDA0: 13GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[372849] 11324MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:16:12 (UTC+8)
29542CUDA0: 29GB / 48GB 97% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[372849] 27444MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:14:37 (UTC+8)
29541CUDA0: 47GB / 48GB 97% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[372849] 46064MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:13:02 (UTC+8)
29540CUDA0: 3GB / 48GB 0% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:11:27 (UTC+8)
29539CUDA0: 18GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[262660] 15124MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:09:53 (UTC+8)
29538CUDA0: 8GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[262660] 5524MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:06:39 (UTC+8)
29537CUDA0: 36GB / 48GB 99% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[262660] 36144MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:05:04 (UTC+8)
29536CUDA0: 34GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[262660] 31504MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:03:29 (UTC+8)
29535CUDA0: 27GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[262660] 24504MB | CUDA1 PID:[2443] 30998MB | CUDA1 PID:[196210] 6682MB)260621-19:01:54 (UTC+8)
29534CUDA0: 9GB / 48GB 93% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[132073] 6244MB | CUDA1 PID:[2443] 23358MB | CUDA1 PID:[196210] 6682MB)260621-18:58:40 (UTC+8)
29533CUDA0: 3GB / 48GB 82% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2443] 34336MB | CUDA1 PID:[4144359] 6692MB)260621-18:48:51 (UTC+8)
29532CUDA0: 44GB / 48GB 99% || CUDA1: 29GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[21501] 44284MB | CUDA1 PID:[2443] 23376MB | CUDA1 PID:[4144359] 6692MB)260621-18:47:16 (UTC+8)
29531CUDA0: 40GB / 48GB 98% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[21501] 40264MB | CUDA1 PID:[2443] 41276MB | CUDA1 PID:[4144359] 6692MB)260621-18:45:41 (UTC+8)
29530CUDA0: 36GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[21501] 35164MB | CUDA1 PID:[2443] 34336MB | CUDA1 PID:[4144359] 6692MB)260621-18:44:07 (UTC+8)
29529CUDA0: 38GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[21501] 37904MB | CUDA1 PID:[2443] 22198MB | CUDA1 PID:[4144359] 6692MB)260621-18:42:32 (UTC+8)
29528CUDA0: 34GB / 48GB 98% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[21501] 34344MB | CUDA1 PID:[2443] 16626MB | CUDA1 PID:[4144359] 6692MB)260621-18:40:57 (UTC+8)
29527CUDA0: 36GB / 48GB 93% || CUDA1: 37GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[21501] 34164MB | CUDA1 PID:[2443] 30678MB | CUDA1 PID:[4144359] 6692MB)260621-18:39:22 (UTC+8)
29526CUDA0: 18GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16304MB | CUDA1 PID:[2443] 18634MB | CUDA1 PID:[4144359] 6692MB)260621-18:37:47 (UTC+8)
29525CUDA0: 18GB / 48GB 100% || CUDA1: 16GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[4177719] 9368MB | CUDA1 PID:[4144359] 6690MB)260621-18:36:13 (UTC+8)
29524CUDA0: 18GB / 48GB 89% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[4166049] 9368MB | CUDA1 PID:[4144359] 6690MB)260621-18:34:38 (UTC+8)
29523CUDA0: 18GB / 48GB 100% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[4138732] 9804MB | CUDA1 PID:[4144359] 6690MB)260621-18:33:03 (UTC+8)
29522CUDA0: 18GB / 48GB 96% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:31:28 (UTC+8)
29521CUDA0: 18GB / 48GB 96% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16026MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:29:53 (UTC+8)
29520CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16166MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:28:19 (UTC+8)
29519CUDA0: 18GB / 48GB 97% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16304MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:26:44 (UTC+8)
29518CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16284MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:25:09 (UTC+8)
29517CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:23:34 (UTC+8)
29516CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[4003162] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:21:59 (UTC+8)
29515CUDA0: 18GB / 48GB 97% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[4003162] 13584MB | CUDA1 PID:[3878104] 6690MB)260621-18:20:24 (UTC+8)
29514CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16292MB | CUDA1 PID:[3885510] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:18:49 (UTC+8)
29513CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[3885510] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:17:14 (UTC+8)
29512CUDA0: 18GB / 48GB 93% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3885510] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:15:40 (UTC+8)
29511CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3885510] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:14:05 (UTC+8)
29510CUDA0: 17GB / 48GB 100% || CUDA1: 22GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16152MB | CUDA1 PID:[3885510] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:12:30 (UTC+8)
29509CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3885510] 16244MB | CUDA1 PID:[3878104] 6690MB)260621-18:10:55 (UTC+8)
29508CUDA0: 18GB / 48GB 96% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16296MB | CUDA1 PID:[3885510] 13604MB | CUDA1 PID:[3878104] 6690MB)260621-18:09:20 (UTC+8)
29507CUDA0: 18GB / 48GB 100% || CUDA1: 16GB / 48GB 82% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3885510] 9222MB | CUDA1 PID:[3878104] 6690MB)260621-18:07:45 (UTC+8)
29506CUDA0: 18GB / 48GB 96% || CUDA1: 9GB / 48GB 66% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16236MB | CUDA1 PID:[3866504] 9462MB)260621-18:06:10 (UTC+8)
29505CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[3752149] 22624MB)260621-18:04:35 (UTC+8)
29504CUDA0: 18GB / 48GB 97% || CUDA1: 22GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[3752149] 22624MB)260621-18:03:00 (UTC+8)
29503CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 15906MB | CUDA1 PID:[3752149] 22624MB)260621-18:01:26 (UTC+8)
29502CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[3752149] 22624MB)260621-17:59:51 (UTC+8)
29501CUDA0: 18GB / 48GB 92% || CUDA1: 22GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3752149] 22064MB)260621-17:58:16 (UTC+8)
29500CUDA0: 18GB / 48GB 96% || CUDA1: 22GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3752149] 22062MB)260621-17:56:41 (UTC+8)
29499CUDA0: 18GB / 48GB 100% || CUDA1: 9GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3752149] 9162MB)260621-17:55:07 (UTC+8)
29498CUDA0: 18GB / 48GB 94% || CUDA1: 21GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16292MB | CUDA1 PID:[3646732] 21864MB)260621-17:53:32 (UTC+8)
29497CUDA0: 18GB / 48GB 97% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16166MB | CUDA1 PID:[3646732] 21864MB)260621-17:51:58 (UTC+8)
29496CUDA0: 18GB / 48GB 100% || CUDA1: 21GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3646732] 21864MB)260621-17:50:23 (UTC+8)
29495CUDA0: 18GB / 48GB 100% || CUDA1: 21GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16276MB | CUDA1 PID:[3646732] 21864MB)260621-17:48:48 (UTC+8)
29494CUDA0: 17GB / 48GB 100% || CUDA1: 21GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16118MB | CUDA1 PID:[3646732] 21864MB)260621-17:47:13 (UTC+8)
29493CUDA0: 18GB / 48GB 90% || CUDA1: 21GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16304MB | CUDA1 PID:[3646732] 21242MB)260621-17:45:38 (UTC+8)
29492CUDA0: 18GB / 48GB 100% || CUDA1: 10GB / 48GB 82% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3600252] 9708MB)260621-17:44:03 (UTC+8)
29491CUDA0: 18GB / 48GB 100% || CUDA1: 10GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16306MB | CUDA1 PID:[3600252] 9708MB)260621-17:42:29 (UTC+8)
29490CUDA0: 18GB / 48GB 100% || CUDA1: 9GB / 48GB 85% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16292MB | CUDA1 PID:[3600252] 9626MB)260621-17:40:54 (UTC+8)
29489CUDA0: 18GB / 48GB 100% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16296MB | CUDA1 PID:[3457181] 12086MB)260621-17:39:20 (UTC+8)
29488CUDA0: 18GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16308MB | CUDA1 PID:[3457181] 12086MB)260621-17:37:45 (UTC+8)
29487CUDA0: 18GB / 48GB 92% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16294MB | CUDA1 PID:[3457181] 12086MB)260621-17:36:10 (UTC+8)
29486CUDA0: 18GB / 48GB 100% || CUDA1: 12GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3457181] 12086MB)260621-17:34:35 (UTC+8)
29485CUDA0: 18GB / 48GB 96% || CUDA1: 12GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[3457181] 11946MB)260621-17:31:21 (UTC+8)
29484CUDA0: 18GB / 48GB 100% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16306MB | CUDA1 PID:[3457181] 11306MB)260621-17:29:47 (UTC+8)
29483CUDA0: 18GB / 48GB 100% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16174MB | CUDA1 PID:[3457181] 11306MB)260621-17:28:12 (UTC+8)
29482CUDA0: 18GB / 48GB 97% || CUDA1: 9GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3452201] 9426MB)260621-17:26:37 (UTC+8)
29481CUDA0: 18GB / 48GB 100% || CUDA1: 9GB / 48GB 81% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[3435309] 9508MB)260621-17:25:02 (UTC+8)
29480CUDA0: 18GB / 48GB 97% || CUDA1: 10GB / 48GB 85% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16304MB | CUDA1 PID:[3413765] 9824MB)260621-17:23:28 (UTC+8)
29479CUDA0: 18GB / 48GB 97% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[3320328] 16364MB)260621-17:21:53 (UTC+8)
29478CUDA0: 18GB / 48GB 97% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3320328] 16364MB)260621-17:20:18 (UTC+8)
29477CUDA0: 18GB / 48GB 100% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16066MB | CUDA1 PID:[3320328] 16364MB)260621-17:18:43 (UTC+8)
29476CUDA0: 18GB / 48GB 96% || CUDA1: 16GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3320328] 16364MB)260621-17:17:09 (UTC+8)
29475CUDA0: 18GB / 48GB 100% || CUDA1: 14GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3320328] 14584MB)260621-17:15:34 (UTC+8)
29474CUDA0: 17GB / 48GB 93% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16146MB | CUDA1 PID:[3320328] 11964MB)260621-17:13:59 (UTC+8)
29473CUDA0: 18GB / 48GB 100% || CUDA1: 16GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16310MB | CUDA1 PID:[3234378] 16384MB)260621-17:12:24 (UTC+8)
29472CUDA0: 18GB / 48GB 96% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3234378] 16384MB)260621-17:10:50 (UTC+8)
29471CUDA0: 18GB / 48GB 97% || CUDA1: 16GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16196MB | CUDA1 PID:[3234378] 16384MB)260621-17:09:15 (UTC+8)
29470CUDA0: 18GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3234378] 12424MB)260621-17:06:01 (UTC+8)
29469CUDA0: 18GB / 48GB 97% || CUDA1: 9GB / 48GB 81% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3210727] 9502MB)260621-17:04:27 (UTC+8)
29468CUDA0: 18GB / 48GB 98% || CUDA1: 23GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16184MB | CUDA1 PID:[3107031] 23484MB)260621-17:02:52 (UTC+8)
29467CUDA0: 18GB / 48GB 96% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[3107031] 23484MB)260621-17:01:17 (UTC+8)
29466CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3107031] 23484MB)260621-16:59:42 (UTC+8)
29465CUDA0: 18GB / 48GB 99% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16310MB | CUDA1 PID:[3107031] 23484MB)260621-16:58:07 (UTC+8)
29464CUDA0: 17GB / 48GB 96% || CUDA1: 23GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16134MB | CUDA1 PID:[3107031] 23484MB)260621-16:56:33 (UTC+8)
29463CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[3107031] 23484MB)260621-16:54:58 (UTC+8)
29462CUDA0: 18GB / 48GB 100% || CUDA1: 11GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16300MB | CUDA1 PID:[3107031] 11522MB)260621-16:53:23 (UTC+8)
29461CUDA0: 18GB / 48GB 92% || CUDA1: 23GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16302MB | CUDA1 PID:[2999360] 23484MB)260621-16:51:48 (UTC+8)
29460CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16306MB | CUDA1 PID:[2999360] 23484MB)260621-16:50:13 (UTC+8)
29459CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[2999360] 23484MB)260621-16:48:38 (UTC+8)
29458CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16304MB | CUDA1 PID:[2999360] 23484MB)260621-16:47:03 (UTC+8)
29457CUDA0: 17GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16106MB | CUDA1 PID:[2999360] 23484MB)260621-16:45:28 (UTC+8)
29456CUDA0: 17GB / 48GB 96% || CUDA1: 23GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16086MB | CUDA1 PID:[2999360] 23484MB)260621-16:43:54 (UTC+8)
29455CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[2917613] 9748MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6684MB)260621-16:42:19 (UTC+8)
29454CUDA0: 18GB / 48GB 96% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16306MB | CUDA1 PID:[2917613] 9748MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6684MB)260621-16:40:44 (UTC+8)
29453CUDA0: 18GB / 48GB 96% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[2917613] 9748MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6684MB)260621-16:39:09 (UTC+8)
29452CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[2917613] 9748MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:37:35 (UTC+8)
29451CUDA0: 18GB / 48GB 96% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[2917613] 9644MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:36:00 (UTC+8)
29450CUDA0: 18GB / 48GB 100% || CUDA1: 13GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16296MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:34:25 (UTC+8)
29449CUDA0: 18GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16186MB | CUDA1 PID:[2883112] 9368MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:32:50 (UTC+8)
29448CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16310MB | CUDA1 PID:[2844228] 9844MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:31:15 (UTC+8)
29447CUDA0: 18GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[2844228] 9824MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:29:40 (UTC+8)
29446CUDA0: 18GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:28:05 (UTC+8)
29445CUDA0: 18GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16292MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:26:31 (UTC+8)
29444CUDA0: 17GB / 48GB 97% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16146MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:24:56 (UTC+8)
29443CUDA0: 18GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16246MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:23:21 (UTC+8)
29442CUDA0: 18GB / 48GB 90% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:21:46 (UTC+8)
29441CUDA0: 18GB / 48GB 97% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16202MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:20:11 (UTC+8)
29440CUDA0: 18GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16288MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:18:37 (UTC+8)
29439CUDA0: 18GB / 48GB 96% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16292MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:17:02 (UTC+8)
29438CUDA0: 18GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2697787] 16298MB | CUDA1 PID:[2683186] 14964MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:15:27 (UTC+8)
29437CUDA0: 2GB / 48GB 0% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[2683186] 13564MB | CUDA1 PID:[2540968] 6684MB | CUDA1 PID:[2544206] 6682MB)260621-16:13:52 (UTC+8)
29436CUDA0: 28GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2383753] 16242MB | CUDA0 PID:[1112397] 11444MB | CUDA1 PID:[2371984] 22884MB | CUDA1 PID:[2053145] 6690MB)260621-15:44:12 (UTC+8)
29435CUDA0: 47GB / 48GB 100% || CUDA1: 29GB / 48GB 88% [双卡负载] (高占用进程: CUDA0 PID:[2383753] 34482MB | CUDA0 PID:[1112397] 11444MB | CUDA1 PID:[2371984] 22884MB | CUDA1 PID:[2053145] 6690MB)260621-15:40:55 (UTC+8)
29434CUDA0: 17GB / 48GB 100% || CUDA1: 27GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 9702MB | CUDA0 PID:[2383753] 5620MB | CUDA1 PID:[2371984] 21244MB | CUDA1 PID:[2053145] 6690MB)260621-15:37:41 (UTC+8)
29433CUDA0: 30GB / 48GB 100% || CUDA1: 16GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[2186613] 16062MB | CUDA0 PID:[1112397] 11552MB | CUDA1 PID:[2280987] 9368MB | CUDA1 PID:[2053145] 6690MB)260621-15:26:12 (UTC+8)
29432CUDA0: 44GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2186613] 32142MB | CUDA0 PID:[1112397] 11552MB | CUDA1 PID:[2117164] 16344MB | CUDA1 PID:[2053145] 6690MB)260621-15:21:19 (UTC+8)
29431CUDA0: 25GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2186613] 12302MB | CUDA0 PID:[1112397] 11552MB | CUDA1 PID:[2117164] 16344MB | CUDA1 PID:[2053145] 6690MB)260621-15:19:44 (UTC+8)
29430CUDA0: 43GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1975597] 30564MB | CUDA0 PID:[1112397] 11552MB | CUDA1 PID:[2117164] 16244MB | CUDA1 PID:[2053145] 6690MB)260621-15:11:34 (UTC+8)
29429CUDA0: 46GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1975597] 34044MB | CUDA0 PID:[1112397] 10610MB | CUDA1 PID:[2003504] 16244MB | CUDA1 PID:[2053145] 6690MB)260621-15:05:01 (UTC+8)
29428CUDA0: 19GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10610MB | CUDA0 PID:[1975597] 7204MB | CUDA1 PID:[2003504] 16244MB | CUDA1 PID:[1799235] 6692MB)260621-15:01:48 (UTC+8)
29427CUDA0: 47GB / 48GB 97% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1759495] 35364MB | CUDA0 PID:[1112397] 10690MB | CUDA1 PID:[1755660] 23724MB | CUDA1 PID:[1799235] 6692MB)260621-14:50:18 (UTC+8)
29426CUDA0: 30GB / 48GB 99% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1759495] 17784MB | CUDA0 PID:[1112397] 10690MB | CUDA1 PID:[1755660] 23724MB | CUDA1 PID:[1799235] 6692MB)260621-14:45:25 (UTC+8)
29425CUDA0: 26GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1759495] 14084MB | CUDA0 PID:[1112397] 10690MB | CUDA1 PID:[1755660] 23724MB | CUDA1 PID:[1799235] 6690MB)260621-14:43:51 (UTC+8)
29424CUDA0: 23GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1759495] 10764MB | CUDA0 PID:[1112397] 10690MB | CUDA1 PID:[1755660] 23724MB | CUDA1 PID:[1799235] 6690MB)260621-14:40:37 (UTC+8)
29423CUDA0: 21GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10690MB | CUDA0 PID:[1759495] 9464MB | CUDA1 PID:[1755660] 23184MB | CUDA1 PID:[1138553] 6684MB)260621-14:37:23 (UTC+8)
29422CUDA0: 25GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1759495] 11984MB | CUDA0 PID:[1112397] 10688MB | CUDA1 PID:[1755660] 20322MB | CUDA1 PID:[1138553] 6684MB)260621-14:35:48 (UTC+8)
29421CUDA0: 13GB / 48GB 99% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10708MB | CUDA1 PID:[1368853] 23764MB | CUDA1 PID:[1138553] 6684MB)260621-14:32:34 (UTC+8)
29420CUDA0: 38GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1363551] 26784MB | CUDA0 PID:[1112397] 10708MB | CUDA1 PID:[1368853] 23764MB | CUDA1 PID:[1138553] 6682MB)260621-14:30:59 (UTC+8)
29419CUDA0: 18GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10708MB | CUDA0 PID:[1363551] 5544MB | CUDA1 PID:[1368853] 23044MB | CUDA1 PID:[1138553] 6682MB)260621-14:26:06 (UTC+8)
29418CUDA0: 18GB / 48GB 95% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10708MB | CUDA0 PID:[1363551] 5924MB | CUDA1 PID:[1368853] 23044MB | CUDA1 PID:[1138553] 6682MB)260621-14:24:32 (UTC+8)
29417CUDA0: 29GB / 48GB 98% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1363551] 17244MB | CUDA0 PID:[1112397] 10708MB | CUDA1 PID:[1368853] 23044MB | CUDA1 PID:[1138553] 6682MB)260621-14:22:57 (UTC+8)
29416CUDA0: 40GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1363551] 27604MB | CUDA0 PID:[1112397] 10708MB | CUDA1 PID:[1368853] 22064MB | CUDA1 PID:[1138553] 6682MB)260621-14:19:43 (UTC+8)
29415CUDA0: 39GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1363551] 28004MB | CUDA0 PID:[1112397] 10708MB | CUDA1 PID:[1368853] 22064MB | CUDA1 PID:[1138553] 6682MB)260621-14:18:08 (UTC+8)
29414CUDA0: 34GB / 48GB 100% || CUDA1: 16GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[986142] 23262MB | CUDA0 PID:[1112397] 9748MB | CUDA1 PID:[1238844] 9648MB | CUDA1 PID:[1138553] 6682MB)260621-14:11:37 (UTC+8)
29413CUDA0: 44GB / 48GB 100% || CUDA1: 16GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[986142] 33462MB | CUDA0 PID:[1112397] 9748MB | CUDA1 PID:[1238844] 9646MB | CUDA1 PID:[1138553] 6682MB)260621-14:10:02 (UTC+8)
29412CUDA0: 47GB / 48GB 100% || CUDA1: 19GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[986142] 37802MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[1138553] 6682MB)260621-14:08:27 (UTC+8)
29411CUDA0: 40GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[986142] 28302MB | CUDA0 PID:[1112397] 10682MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[668600] 6690MB)260621-14:03:34 (UTC+8)
29410CUDA0: 42GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[986142] 30162MB | CUDA0 PID:[1112397] 10682MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[668600] 6690MB)260621-14:00:20 (UTC+8)
29409CUDA0: 34GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[986142] 22262MB | CUDA0 PID:[1112397] 10682MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[668600] 6690MB)260621-13:58:45 (UTC+8)
29408CUDA0: 22GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10682MB | CUDA0 PID:[986142] 9742MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[668600] 6690MB)260621-13:57:11 (UTC+8)
29407CUDA0: 13GB / 48GB 99% || CUDA1: 19GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10682MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[668600] 6690MB)260621-13:55:36 (UTC+8)
29406CUDA0: 13GB / 48GB 99% || CUDA1: 19GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10682MB | CUDA1 PID:[856384] 12286MB | CUDA1 PID:[668600] 6690MB)260621-13:54:01 (UTC+8)
29405CUDA0: 31GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[624584] 20384MB | CUDA0 PID:[1112397] 10682MB | CUDA1 PID:[856384] 11206MB | CUDA1 PID:[668600] 6690MB)260621-13:52:27 (UTC+8)
29404CUDA0: 35GB / 48GB 100% || CUDA1: 18GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[624584] 23704MB | CUDA0 PID:[1112397] 9784MB | CUDA1 PID:[856384] 11206MB | CUDA1 PID:[668600] 6690MB)260621-13:50:52 (UTC+8)
29403CUDA0: 20GB / 48GB 100% || CUDA1: 15GB / 48GB 86% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 9784MB | CUDA0 PID:[624584] 8204MB | CUDA1 PID:[856384] 9122MB | CUDA1 PID:[668600] 6690MB)260621-13:49:18 (UTC+8)
29402CUDA0: 29GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[624584] 18604MB | CUDA0 PID:[1112397] 9784MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[668600] 6690MB)260621-13:47:43 (UTC+8)
29401CUDA0: 31GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[624584] 20944MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[668600] 6690MB)260621-13:46:08 (UTC+8)
29400CUDA0: 21GB / 48GB 100% || CUDA1: 19GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[624584] 11344MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[668600] 6690MB)260621-13:44:33 (UTC+8)
29399CUDA0: 22GB / 48GB 100% || CUDA1: 19GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[624584] 12584MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[668600] 6690MB)260621-13:42:59 (UTC+8)
29398CUDA0: 21GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[624584] 10824MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[668600] 6690MB)260621-13:41:24 (UTC+8)
29397CUDA0: 19GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 8894MB | CUDA0 PID:[624584] 8484MB | CUDA1 PID:[479724] 12446MB)260621-13:39:49 (UTC+8)
29396CUDA0: 34GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[624584] 23584MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[247485] 6692MB)260621-13:38:14 (UTC+8)
29395CUDA0: 15GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12430MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[247485] 6692MB)260621-13:36:39 (UTC+8)
29394CUDA0: 15GB / 48GB 56% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12430MB | CUDA1 PID:[479724] 12446MB | CUDA1 PID:[247485] 6692MB)260621-13:35:04 (UTC+8)
29393CUDA0: 29GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[306831] 14344MB | CUDA0 PID:[1112397] 12430MB | CUDA1 PID:[479724] 11306MB | CUDA1 PID:[247485] 6692MB)260621-13:33:29 (UTC+8)
29392CUDA0: 23GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12430MB | CUDA0 PID:[306831] 9444MB | CUDA1 PID:[479724] 11306MB | CUDA1 PID:[247485] 6692MB)260621-13:31:54 (UTC+8)
29391CUDA0: 38GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[306831] 23544MB | CUDA0 PID:[1112397] 12430MB | CUDA1 PID:[479724] 11206MB | CUDA1 PID:[247485] 6692MB)260621-13:30:19 (UTC+8)
29390CUDA0: 30GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[306831] 16784MB | CUDA0 PID:[1112397] 12430MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6692MB)260621-13:28:45 (UTC+8)
29389CUDA0: 31GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[306831] 18064MB | CUDA0 PID:[1112397] 12414MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6692MB)260621-13:27:10 (UTC+8)
29388CUDA0: 29GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[306831] 15224MB | CUDA0 PID:[1112397] 12414MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6692MB)260621-13:23:56 (UTC+8)
29387CUDA0: 35GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[306831] 21344MB | CUDA0 PID:[1112397] 12414MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6692MB)260621-13:22:21 (UTC+8)
29386CUDA0: 15GB / 48GB 98% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12414MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6692MB)260621-13:20:46 (UTC+8)
29385CUDA0: 14GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11502MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6690MB)260621-13:19:12 (UTC+8)
29384CUDA0: 37GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[210261] 24544MB | CUDA0 PID:[1112397] 11502MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6690MB)260621-13:17:37 (UTC+8)
29383CUDA0: 23GB / 48GB 100% || CUDA1: 19GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11502MB | CUDA0 PID:[210261] 10644MB | CUDA1 PID:[235338] 12286MB | CUDA1 PID:[247485] 6690MB)260621-13:16:02 (UTC+8)
29382CUDA0: 45GB / 48GB 100% || CUDA1: 12GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[210261] 32884MB | CUDA0 PID:[1112397] 10614MB | CUDA1 PID:[235338] 12286MB)260621-13:14:27 (UTC+8)
29381CUDA0: 39GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[210261] 29324MB | CUDA0 PID:[1112397] 9734MB | CUDA1 PID:[235338] 12286MB)260621-13:12:52 (UTC+8)
29380CUDA0: 29GB / 48GB 100% || CUDA1: 12GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[210261] 19024MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[235338] 12286MB)260621-13:11:17 (UTC+8)
29379CUDA0: 38GB / 48GB 100% || CUDA1: 12GB / 48GB 90% [双卡负载] (高占用进程: CUDA0 PID:[210261] 29424MB | CUDA0 PID:[1112397] 8892MB | CUDA1 PID:[192607] 11946MB)260621-13:09:42 (UTC+8)
29378CUDA0: 44GB / 48GB 100% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[210261] 29604MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11946MB)260621-13:08:07 (UTC+8)
29377CUDA0: 23GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12368MB | CUDA0 PID:[210261] 9424MB | CUDA1 PID:[192607] 11946MB)260621-13:06:32 (UTC+8)
29376CUDA0: 42GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[210261] 28564MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11946MB)260621-13:04:57 (UTC+8)
29375CUDA0: 46GB / 48GB 100% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[210261] 33344MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11946MB)260621-13:03:23 (UTC+8)
29374CUDA0: 27GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11946MB)260621-13:01:48 (UTC+8)
29373CUDA0: 27GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11946MB)260621-13:00:13 (UTC+8)
29372CUDA0: 27GB / 48GB 100% || CUDA1: 11GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11306MB)260621-12:58:38 (UTC+8)
29371CUDA0: 27GB / 48GB 100% || CUDA1: 11GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 12368MB | CUDA1 PID:[192607] 11166MB)260621-12:57:03 (UTC+8)
29370CUDA0: 34GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 12368MB | CUDA0 PID:[4116389] 8384MB | CUDA1 PID:[90009] 12286MB)260621-12:55:29 (UTC+8)
29369CUDA0: 45GB / 48GB 100% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[4116389] 20444MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 11400MB | CUDA1 PID:[90009] 12286MB)260621-12:53:54 (UTC+8)
29368CUDA0: 41GB / 48GB 100% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[4116389] 17484MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 11400MB | CUDA1 PID:[90009] 12286MB)260621-12:52:19 (UTC+8)
29367CUDA0: 43GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4116389] 18924MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 11400MB | CUDA1 PID:[90009] 12286MB)260621-12:50:44 (UTC+8)
29366CUDA0: 36GB / 48GB 100% || CUDA1: 12GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 11400MB | CUDA0 PID:[4116389] 9864MB | CUDA1 PID:[90009] 12286MB)260621-12:49:09 (UTC+8)
29365CUDA0: 43GB / 48GB 100% || CUDA1: 12GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[4116389] 17904MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 11400MB | CUDA1 PID:[90009] 12286MB)260621-12:47:34 (UTC+8)
29364CUDA0: 31GB / 48GB 100% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 10534MB | CUDA0 PID:[4116389] 7464MB)260621-12:42:41 (UTC+8)
29363CUDA0: 37GB / 48GB 100% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[4116389] 12884MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 10534MB)260621-12:41:06 (UTC+8)
29362CUDA0: 38GB / 48GB 100% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[4116389] 14544MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 10534MB)260621-12:39:31 (UTC+8)
29361CUDA0: 45GB / 48GB 100% || CUDA1: 0GB / 48GB 0% [单卡负载] (高占用进程: CUDA0 PID:[4116389] 21484MB | CUDA0 PID:[4072103] 12446MB | CUDA0 PID:[1112397] 10534MB)260621-12:37:56 (UTC+8)
29360CUDA0: 36GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4116389] 13084MB | CUDA0 PID:[4072103] 11306MB | CUDA0 PID:[1112397] 10530MB | CUDA1 PID:[3906577] 12286MB)260621-12:36:21 (UTC+8)
29359CUDA0: 45GB / 48GB 100% || CUDA1: 12GB / 48GB 89% [双卡负载] (高占用进程: CUDA0 PID:[4116389] 22204MB | CUDA0 PID:[4072103] 11306MB | CUDA0 PID:[1112397] 10530MB | CUDA1 PID:[3906577] 12286MB)260621-12:34:46 (UTC+8)
29358CUDA0: 23GB / 48GB 100% || CUDA1: 12GB / 48GB 92% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 11306MB | CUDA0 PID:[1112397] 10530MB | CUDA1 PID:[3906577] 12286MB)260621-12:33:12 (UTC+8)
29357CUDA0: 24GB / 48GB 100% || CUDA1: 12GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[4072103] 11206MB | CUDA0 PID:[1112397] 10530MB | CUDA1 PID:[3906577] 12286MB)260621-12:31:37 (UTC+8)
29356CUDA0: 13GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10530MB | CUDA1 PID:[3906577] 12286MB)260621-12:30:02 (UTC+8)
29355CUDA0: 36GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 25304MB | CUDA0 PID:[1112397] 9700MB | CUDA1 PID:[3906577] 12286MB | CUDA1 PID:[4027512] 11106MB)260621-12:28:27 (UTC+8)
29354CUDA0: 27GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 17384MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[3906577] 12286MB)260621-12:26:52 (UTC+8)
29353CUDA0: 29GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3849961] 9828MB | CUDA0 PID:[3730950] 9324MB | CUDA0 PID:[1112397] 8888MB | CUDA1 PID:[3906577] 12126MB)260621-12:25:17 (UTC+8)
29352CUDA0: 39GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 16104MB | CUDA0 PID:[1112397] 12540MB | CUDA0 PID:[3849961] 9828MB | CUDA1 PID:[3906577] 12126MB)260621-12:23:43 (UTC+8)
29351CUDA0: 45GB / 48GB 100% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 21744MB | CUDA0 PID:[1112397] 12540MB | CUDA0 PID:[3849961] 9828MB | CUDA1 PID:[3906577] 12126MB)260621-12:22:08 (UTC+8)
29350CUDA0: 28GB / 48GB 100% || CUDA1: 9GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12540MB | CUDA0 PID:[3849961] 9808MB | CUDA0 PID:[3730950] 4622MB | CUDA1 PID:[3906577] 9584MB)260621-12:20:33 (UTC+8)
29349CUDA0: 42GB / 48GB 100% || CUDA1: 10GB / 48GB 73% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 17924MB | CUDA0 PID:[1112397] 12540MB | CUDA0 PID:[3849961] 9768MB | CUDA1 PID:[3845040] 9828MB)260621-12:18:58 (UTC+8)
29348CUDA0: 42GB / 48GB 100% || CUDA1: 10GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 18744MB | CUDA0 PID:[1112397] 12540MB | CUDA0 PID:[3849961] 9744MB | CUDA1 PID:[3845040] 9788MB)260621-12:17:23 (UTC+8)
29347CUDA0: 33GB / 48GB 100% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 20944MB | CUDA0 PID:[1112397] 11580MB | CUDA1 PID:[3695911] 11046MB)260621-12:15:48 (UTC+8)
29346CUDA0: 27GB / 48GB 100% || CUDA1: 11GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3683307] 9808MB | CUDA0 PID:[3730950] 5664MB | CUDA1 PID:[3695911] 11046MB)260621-12:14:13 (UTC+8)
29345CUDA0: 27GB / 48GB 100% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3683307] 9808MB | CUDA0 PID:[3730950] 5644MB | CUDA1 PID:[3695911] 11046MB)260621-12:12:38 (UTC+8)
29344CUDA0: 34GB / 48GB 100% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3730950] 13084MB | CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3683307] 9808MB | CUDA1 PID:[3695911] 10986MB)260621-12:11:03 (UTC+8)
29343CUDA0: 22GB / 48GB 100% || CUDA1: 11GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3683307] 9808MB | CUDA1 PID:[3695911] 10986MB)260621-12:09:29 (UTC+8)
29342CUDA0: 27GB / 48GB 100% || CUDA1: 11GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3683307] 9788MB | CUDA0 PID:[3649111] 5278MB | CUDA1 PID:[3695911] 10826MB)260621-12:07:54 (UTC+8)
29341CUDA0: 24GB / 48GB 100% || CUDA1: 11GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3571031] 9848MB | CUDA0 PID:[3649111] 2338MB | CUDA1 PID:[3522623] 11026MB)260621-12:06:19 (UTC+8)
29340CUDA0: 22GB / 48GB 100% || CUDA1: 11GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3571031] 9848MB | CUDA1 PID:[3522623] 11026MB)260621-12:04:44 (UTC+8)
29339CUDA0: 23GB / 48GB 100% || CUDA1: 11GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3571031] 9848MB | CUDA1 PID:[3522623] 11026MB)260621-12:03:09 (UTC+8)
29338CUDA0: 22GB / 48GB 100% || CUDA1: 11GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3571031] 9808MB | CUDA1 PID:[3522623] 11026MB)260621-12:01:34 (UTC+8)
29337CUDA0: 22GB / 48GB 100% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10672MB | CUDA0 PID:[3571031] 9728MB | CUDA1 PID:[3522623] 10946MB)260621-11:59:59 (UTC+8)
29336CUDA0: 23GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11086MB | CUDA0 PID:[1112397] 10672MB | CUDA1 PID:[3291284] 37444MB | CUDA1 PID:[3522623] 10946MB)260621-11:58:25 (UTC+8)
29335CUDA0: 23GB / 48GB 100% || CUDA1: 46GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11086MB | CUDA0 PID:[1112397] 10672MB | CUDA1 PID:[3291284] 39344MB | CUDA1 PID:[3522623] 9100MB)260621-11:56:50 (UTC+8)
29334CUDA0: 23GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11086MB | CUDA0 PID:[1112397] 10672MB | CUDA1 PID:[3291284] 21904MB | CUDA1 PID:[3258756] 11026MB)260621-11:55:15 (UTC+8)
29333CUDA0: 23GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11086MB | CUDA0 PID:[1112397] 10672MB | CUDA1 PID:[3291284] 26984MB | CUDA1 PID:[3258756] 11026MB)260621-11:53:40 (UTC+8)
29332CUDA0: 23GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11086MB | CUDA0 PID:[1112397] 10670MB | CUDA1 PID:[3291284] 23684MB | CUDA1 PID:[3258756] 11026MB)260621-11:52:06 (UTC+8)
29331CUDA0: 22GB / 48GB 100% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11026MB | CUDA0 PID:[1112397] 9774MB | CUDA1 PID:[3258756] 11026MB | CUDA1 PID:[3291284] 5004MB)260621-11:50:31 (UTC+8)
29330CUDA0: 22GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11026MB | CUDA0 PID:[1112397] 9774MB | CUDA1 PID:[3291284] 28684MB | CUDA1 PID:[3258756] 11026MB)260621-11:48:56 (UTC+8)
29329CUDA0: 22GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 11026MB | CUDA0 PID:[1112397] 9774MB | CUDA1 PID:[3291284] 28044MB | CUDA1 PID:[3258756] 11026MB)260621-11:47:21 (UTC+8)
29328CUDA0: 22GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 10886MB | CUDA0 PID:[1112397] 9774MB | CUDA1 PID:[3291284] 15544MB | CUDA1 PID:[3258756] 11026MB)260621-11:45:46 (UTC+8)
29327CUDA0: 21GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3308219] 10826MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[3291284] 23704MB | CUDA1 PID:[3258756] 11026MB)260621-11:44:11 (UTC+8)
29326CUDA0: 26GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 14226MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[3291284] 33184MB | CUDA1 PID:[3258756] 10946MB)260621-11:42:36 (UTC+8)
29325CUDA0: 26GB / 48GB 100% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 14226MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[3258756] 10946MB)260621-11:41:01 (UTC+8)
29324CUDA0: 26GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 14226MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[2987720] 47024MB)260621-11:39:27 (UTC+8)
29323CUDA0: 25GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 13230MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[2987720] 35064MB | CUDA1 PID:[2986293] 11086MB)260621-11:37:52 (UTC+8)
29322CUDA0: 25GB / 48GB 98% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 13230MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[2987720] 22764MB | CUDA1 PID:[2986293] 11086MB)260621-11:36:17 (UTC+8)
29321CUDA0: 25GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 13230MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[2986293] 11086MB | CUDA1 PID:[2987720] 8684MB)260621-11:34:42 (UTC+8)
29320CUDA0: 25GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 13230MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[2986293] 11086MB | CUDA1 PID:[2987720] 5884MB)260621-11:33:08 (UTC+8)
29319CUDA0: 25GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 13230MB | CUDA0 PID:[3022487] 11026MB | CUDA1 PID:[2987720] 35744MB | CUDA1 PID:[2986293] 11086MB)260621-11:31:33 (UTC+8)
29318CUDA0: 24GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12280MB | CUDA0 PID:[3022487] 10946MB | CUDA1 PID:[2987720] 28664MB | CUDA1 PID:[2986293] 11026MB)260621-11:29:58 (UTC+8)
29317CUDA0: 24GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12280MB | CUDA0 PID:[3022487] 10946MB | CUDA1 PID:[2987720] 32564MB | CUDA1 PID:[2986293] 11026MB)260621-11:28:23 (UTC+8)
29316CUDA0: 24GB / 48GB 100% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12280MB | CUDA0 PID:[3022487] 10946MB | CUDA1 PID:[2986293] 10886MB | CUDA1 PID:[2987720] 5784MB)260621-11:26:48 (UTC+8)
29315CUDA0: 24GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 12280MB | CUDA0 PID:[2747215] 11026MB | CUDA1 PID:[2987720] 28284MB | CUDA1 PID:[2986293] 10886MB)260621-11:25:14 (UTC+8)
29314CUDA0: 24GB / 48GB 100% || CUDA1: 9GB / 48GB 0% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11414MB | CUDA0 PID:[2747215] 11026MB | CUDA1 PID:[2986293] 9304MB)260621-11:23:39 (UTC+8)
29313CUDA0: 24GB / 48GB 100% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11414MB | CUDA0 PID:[2747215] 11026MB | CUDA1 PID:[2747065] 11046MB)260621-11:22:04 (UTC+8)
29312CUDA0: 24GB / 48GB 100% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11412MB | CUDA0 PID:[2747215] 11026MB | CUDA1 PID:[2747065] 11046MB | CUDA1 PID:[2702211] 5224MB)260621-11:20:29 (UTC+8)
29311CUDA0: 24GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11412MB | CUDA0 PID:[2747215] 11026MB | CUDA1 PID:[2702211] 26544MB | CUDA1 PID:[2747065] 11046MB)260621-11:18:54 (UTC+8)
29310CUDA0: 23GB / 48GB 100% || CUDA1: 41GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[2747215] 11026MB | CUDA0 PID:[1112397] 10550MB | CUDA1 PID:[2702211] 30564MB | CUDA1 PID:[2747065] 11046MB)260621-11:17:20 (UTC+8)
29309CUDA0: 22GB / 48GB 100% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2747215] 11026MB | CUDA0 PID:[1112397] 9710MB | CUDA1 PID:[2702211] 11144MB | CUDA1 PID:[2747065] 11046MB)260621-11:15:45 (UTC+8)
29308CUDA0: 22GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2747215] 11026MB | CUDA0 PID:[1112397] 9710MB | CUDA1 PID:[2702211] 35184MB | CUDA1 PID:[2747065] 10986MB)260621-11:14:10 (UTC+8)
29307CUDA0: 21GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2747215] 10946MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[2702211] 28284MB | CUDA1 PID:[2747065] 10986MB)260621-11:12:36 (UTC+8)
29306CUDA0: 21GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2747215] 10946MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[2702211] 33964MB | CUDA1 PID:[2747065] 10986MB)260621-11:11:01 (UTC+8)
29305CUDA0: 21GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2747215] 10786MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[2702211] 28124MB | CUDA1 PID:[2747065] 10826MB)260621-11:09:26 (UTC+8)
29304CUDA0: 11GB / 48GB 99% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[2702211] 42424MB)260621-11:07:51 (UTC+8)
29303CUDA0: 12GB / 48GB 99% || CUDA1: 41GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10650MB | CUDA1 PID:[2702211] 43104MB)260621-11:06:16 (UTC+8)
29302CUDA0: 37GB / 48GB 100% || CUDA1: 26GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 10650MB | CUDA1 PID:[1924945] 25556MB)260621-11:04:42 (UTC+8)
29301CUDA0: 37GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 10650MB | CUDA1 PID:[1924945] 25556MB | CUDA1 PID:[2408070] 7164MB)260621-11:03:07 (UTC+8)
29300CUDA0: 37GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 10650MB | CUDA1 PID:[1924945] 25556MB | CUDA1 PID:[2408070] 5004MB)260621-11:01:32 (UTC+8)
29299CUDA0: 37GB / 48GB 100% || CUDA1: 25GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 10650MB | CUDA1 PID:[1924945] 25556MB)260621-10:43:26 (UTC+8)
29298CUDA0: 36GB / 48GB 100% || CUDA1: 26GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 9722MB | CUDA1 PID:[1924945] 24996MB)260621-10:41:51 (UTC+8)
29297CUDA0: 35GB / 48GB 96% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[1924945] 24996MB | CUDA1 PID:[2056446] 18024MB)260621-10:38:36 (UTC+8)
29296CUDA0: 35GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 8894MB | CUDA1 PID:[1924945] 24996MB | CUDA1 PID:[2056446] 7044MB)260621-10:36:58 (UTC+8)
29295CUDA0: 38GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25216MB | CUDA0 PID:[1112397] 11554MB | CUDA1 PID:[1924945] 24996MB | CUDA1 PID:[2056446] 13064MB)260621-10:28:47 (UTC+8)
29294CUDA0: 37GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1924810] 25136MB | CUDA0 PID:[1112397] 10646MB | CUDA1 PID:[1924945] 24996MB | CUDA1 PID:[2056446] 6944MB)260621-10:22:15 (UTC+8)
29293CUDA0: 21GB / 48GB 98% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 9740MB | CUDA0 PID:[1924810] 9736MB | CUDA1 PID:[552873] 16302MB | CUDA1 PID:[1924945] 9556MB)260621-10:12:25 (UTC+8)
29292CUDA0: 11GB / 48GB 99% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 9740MB | CUDA1 PID:[552873] 16312MB)260621-10:10:50 (UTC+8)
29291CUDA0: 13GB / 48GB 86% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11448MB | CUDA1 PID:[552873] 16294MB)260621-10:04:18 (UTC+8)
29290CUDA0: 13GB / 48GB 98% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11448MB | CUDA1 PID:[552873] 16294MB)260621-10:02:43 (UTC+8)
29289CUDA0: 13GB / 48GB 62% || CUDA1: 16GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11446MB | CUDA1 PID:[552873] 16298MB)260621-10:01:08 (UTC+8)
29288CUDA0: 12GB / 48GB 95% || CUDA1: 16GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 10554MB | CUDA1 PID:[552873] 16302MB)260621-09:54:37 (UTC+8)
29287CUDA0: 11GB / 48GB 99% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 9704MB | CUDA1 PID:[552873] 16160MB)260621-09:51:23 (UTC+8)
29286CUDA0: 13GB / 48GB 98% || CUDA1: 16GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11634MB | CUDA1 PID:[552873] 16300MB)260621-09:48:09 (UTC+8)
29285CUDA0: 13GB / 48GB 95% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11634MB | CUDA1 PID:[552873] 16300MB)260621-09:41:37 (UTC+8)
29284CUDA0: 13GB / 48GB 99% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1112397] 11634MB | CUDA1 PID:[552873] 16298MB)260621-09:40:02 (UTC+8)
29283CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB | CUDA1 PID:[802218] 6604MB)260621-09:25:15 (UTC+8)
29282CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16306MB | CUDA1 PID:[802218] 6604MB)260621-09:23:40 (UTC+8)
29281CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16246MB | CUDA1 PID:[802218] 6604MB)260621-09:22:05 (UTC+8)
29280CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16246MB | CUDA1 PID:[802218] 6604MB)260621-09:20:30 (UTC+8)
29279CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16296MB | CUDA1 PID:[802218] 6604MB)260621-09:18:55 (UTC+8)
29278CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16108MB | CUDA1 PID:[802218] 6604MB)260621-09:17:20 (UTC+8)
29277CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 97% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16296MB | CUDA1 PID:[802218] 6604MB)260621-08:51:20 (UTC+8)
29276CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16246MB | CUDA1 PID:[662924] 6604MB)260621-08:46:27 (UTC+8)
29275CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 95% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16246MB | CUDA1 PID:[662924] 6604MB)260621-08:44:53 (UTC+8)
29274CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB | CUDA1 PID:[662924] 6604MB)260621-08:43:19 (UTC+8)
29273CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16294MB | CUDA1 PID:[662924] 6604MB)260621-08:41:44 (UTC+8)
29272CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16298MB | CUDA1 PID:[662924] 6604MB)260621-08:40:10 (UTC+8)
29271CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16246MB | CUDA1 PID:[662924] 6604MB)260621-08:38:35 (UTC+8)
29270CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16186MB | CUDA1 PID:[662924] 6604MB)260621-08:37:01 (UTC+8)
29269CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16298MB | CUDA1 PID:[662924] 6604MB)260621-08:35:26 (UTC+8)
29268CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16302MB | CUDA1 PID:[662924] 6604MB)260621-08:33:52 (UTC+8)
29267CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16206MB | CUDA1 PID:[662924] 6604MB)260621-08:32:17 (UTC+8)
29266CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16298MB | CUDA1 PID:[662924] 6604MB)260621-08:30:43 (UTC+8)
29265CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 15826MB | CUDA1 PID:[662924] 6604MB)260621-08:29:08 (UTC+8)
29264CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB | CUDA1 PID:[662924] 6604MB)260621-08:27:34 (UTC+8)
29263CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16298MB | CUDA1 PID:[662924] 6604MB)260621-08:26:00 (UTC+8)
29262CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16296MB | CUDA1 PID:[662924] 6604MB)260621-08:24:25 (UTC+8)
29261CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 98% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16302MB | CUDA1 PID:[662924] 6604MB)260621-08:22:51 (UTC+8)
29260CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 97% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16302MB | CUDA1 PID:[662924] 6604MB)260621-08:21:16 (UTC+8)
29259CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 97% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16246MB | CUDA1 PID:[662924] 6604MB)260621-08:19:41 (UTC+8)
29258CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 98% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16298MB | CUDA1 PID:[662924] 6604MB)260621-08:18:07 (UTC+8)
29257CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 98% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16288MB | CUDA1 PID:[662924] 6604MB)260621-08:16:33 (UTC+8)
29256CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16106MB | CUDA1 PID:[662924] 6604MB)260621-08:14:58 (UTC+8)
29255CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB | CUDA1 PID:[662924] 6604MB)260621-08:13:24 (UTC+8)
29254CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16298MB | CUDA1 PID:[662924] 6604MB)260621-08:11:49 (UTC+8)
29253CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 97% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB | CUDA1 PID:[662924] 6604MB)260621-08:10:15 (UTC+8)
29252CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16302MB | CUDA1 PID:[662924] 6604MB)260621-08:08:40 (UTC+8)
29251CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16310MB | CUDA1 PID:[662924] 6604MB)260621-08:07:06 (UTC+8)
29250CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB | CUDA1 PID:[662924] 6604MB)260621-08:05:31 (UTC+8)
29249CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16168MB | CUDA1 PID:[662924] 6604MB)260621-08:03:57 (UTC+8)
29248CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16292MB | CUDA1 PID:[662924] 6604MB)260621-08:02:22 (UTC+8)
29247CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 96% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16188MB | CUDA1 PID:[662924] 6604MB)260621-08:00:48 (UTC+8)
29246CUDA0: 2GB / 48GB 0% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16302MB | CUDA1 PID:[662924] 5724MB)260621-07:59:14 (UTC+8)
29245CUDA0: 2GB / 48GB 0% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16300MB)260621-07:57:39 (UTC+8)
29244CUDA0: 7GB / 48GB 83% || CUDA1: 16GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16292MB)260621-07:56:05 (UTC+8)
29243CUDA0: 7GB / 48GB 81% || CUDA1: 16GB / 48GB 90% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16304MB)260621-07:54:30 (UTC+8)
29242CUDA0: 7GB / 48GB 98% || CUDA1: 16GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16296MB)260621-07:52:56 (UTC+8)
29241CUDA0: 7GB / 48GB 87% || CUDA1: 16GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16126MB)260621-07:51:21 (UTC+8)
29240CUDA0: 7GB / 48GB 80% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16288MB)260621-07:49:47 (UTC+8)
29239CUDA0: 7GB / 48GB 90% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16298MB)260621-07:48:12 (UTC+8)
29238CUDA0: 7GB / 48GB 78% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16294MB)260621-07:46:38 (UTC+8)
29237CUDA0: 7GB / 48GB 86% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16246MB)260621-07:45:03 (UTC+8)
29236CUDA0: 7GB / 48GB 95% || CUDA1: 16GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16246MB)260621-07:43:29 (UTC+8)
29235CUDA0: 7GB / 48GB 84% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16292MB)260621-07:41:54 (UTC+8)
29234CUDA0: 7GB / 48GB 91% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[601999] 5724MB | CUDA1 PID:[552873] 16302MB)260621-07:40:20 (UTC+8)
29233CUDA0: 2GB / 48GB 0% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[552873] 16294MB)260621-07:38:45 (UTC+8)
29232CUDA0: 7GB / 48GB 86% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16300MB)260621-07:37:11 (UTC+8)
29231CUDA0: 7GB / 48GB 82% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16304MB)260621-07:35:36 (UTC+8)
29230CUDA0: 7GB / 48GB 85% || CUDA1: 16GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16296MB)260621-07:34:02 (UTC+8)
29229CUDA0: 7GB / 48GB 86% || CUDA1: 16GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16246MB)260621-07:32:28 (UTC+8)
29228CUDA0: 7GB / 48GB 96% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16308MB)260621-07:30:53 (UTC+8)
29227CUDA0: 7GB / 48GB 82% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16302MB)260621-07:29:19 (UTC+8)
29226CUDA0: 7GB / 48GB 85% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16292MB)260621-07:27:44 (UTC+8)
29225CUDA0: 7GB / 48GB 86% || CUDA1: 16GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16300MB)260621-07:26:10 (UTC+8)
29224CUDA0: 7GB / 48GB 83% || CUDA1: 16GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16222MB)260621-07:24:35 (UTC+8)
29223CUDA0: 7GB / 48GB 79% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5724MB | CUDA1 PID:[552873] 16246MB)260621-07:23:01 (UTC+8)
29222CUDA0: 7GB / 48GB 83% || CUDA1: 16GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[552198] 5722MB | CUDA1 PID:[552873] 16026MB)260621-07:21:26 (UTC+8)
29221CUDA0: 7GB / 48GB 84% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 9726MB)260621-07:19:52 (UTC+8)
29220CUDA0: 7GB / 48GB 80% || CUDA1: 10GB / 48GB 85% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 9726MB)260621-07:18:18 (UTC+8)
29219CUDA0: 7GB / 48GB 77% || CUDA1: 13GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 13176MB)260621-07:16:43 (UTC+8)
29218CUDA0: 7GB / 48GB 83% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:15:09 (UTC+8)
29217CUDA0: 7GB / 48GB 96% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:13:34 (UTC+8)
29216CUDA0: 7GB / 48GB 85% || CUDA1: 12GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:12:00 (UTC+8)
29215CUDA0: 7GB / 48GB 84% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:10:25 (UTC+8)
29214CUDA0: 7GB / 48GB 83% || CUDA1: 12GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:08:51 (UTC+8)
29213CUDA0: 7GB / 48GB 87% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[511559] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:07:16 (UTC+8)
29212CUDA0: 7GB / 48GB 83% || CUDA1: 12GB / 48GB 68% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 12216MB)260621-07:05:42 (UTC+8)
29211CUDA0: 7GB / 48GB 84% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 12214MB)260621-07:04:07 (UTC+8)
29210CUDA0: 7GB / 48GB 86% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 10440MB)260621-07:02:33 (UTC+8)
29209CUDA0: 7GB / 48GB 84% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 8846MB)260621-07:00:59 (UTC+8)
29208CUDA0: 7GB / 48GB 86% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 10706MB)260621-06:59:24 (UTC+8)
29207CUDA0: 7GB / 48GB 84% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 10706MB)260621-06:57:50 (UTC+8)
29206CUDA0: 7GB / 48GB 85% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5804MB | CUDA1 PID:[1529811] 10706MB)260621-06:56:15 (UTC+8)
29205CUDA0: 7GB / 48GB 85% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5802MB | CUDA1 PID:[1529811] 10706MB)260621-06:54:41 (UTC+8)
29204CUDA0: 7GB / 48GB 83% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5802MB | CUDA1 PID:[1529811] 10706MB)260621-06:53:06 (UTC+8)
29203CUDA0: 7GB / 48GB 86% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5802MB | CUDA1 PID:[1529811] 10706MB)260621-06:51:32 (UTC+8)
29202CUDA0: 7GB / 48GB 86% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[461281] 5802MB | CUDA1 PID:[1529811] 10706MB)260621-06:49:57 (UTC+8)
29201CUDA0: 2GB / 48GB 0% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA1 PID:[1529811] 10706MB)260621-06:48:23 (UTC+8)
29200CUDA0: 7GB / 48GB 97% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 10704MB)260621-06:46:48 (UTC+8)
29199CUDA0: 7GB / 48GB 86% || CUDA1: 9GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 8846MB)260621-06:45:14 (UTC+8)
29198CUDA0: 7GB / 48GB 83% || CUDA1: 14GB / 48GB 64% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 14122MB)260621-06:43:39 (UTC+8)
29197CUDA0: 7GB / 48GB 83% || CUDA1: 13GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 13204MB)260621-06:42:05 (UTC+8)
29196CUDA0: 7GB / 48GB 82% || CUDA1: 13GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 13204MB)260621-06:40:30 (UTC+8)
29195CUDA0: 7GB / 48GB 79% || CUDA1: 13GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 13204MB)260621-06:38:56 (UTC+8)
29194CUDA0: 7GB / 48GB 84% || CUDA1: 13GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 13204MB)260621-06:37:21 (UTC+8)
29193CUDA0: 7GB / 48GB 81% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5724MB | CUDA1 PID:[1529811] 11384MB)260621-06:35:47 (UTC+8)
29192CUDA0: 7GB / 48GB 84% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[420839] 5722MB | CUDA1 PID:[1529811] 11384MB)260621-06:34:13 (UTC+8)
29191CUDA0: 7GB / 48GB 81% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 11384MB)260621-06:32:38 (UTC+8)
29190CUDA0: 7GB / 48GB 86% || CUDA1: 9GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 9648MB)260621-06:31:04 (UTC+8)
29189CUDA0: 7GB / 48GB 77% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 9646MB)260621-06:29:29 (UTC+8)
29188CUDA0: 7GB / 48GB 84% || CUDA1: 12GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 12268MB)260621-06:27:55 (UTC+8)
29187CUDA0: 7GB / 48GB 89% || CUDA1: 12GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 12268MB)260621-06:26:20 (UTC+8)
29186CUDA0: 7GB / 48GB 97% || CUDA1: 12GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 12268MB)260621-06:24:46 (UTC+8)
29185CUDA0: 7GB / 48GB 82% || CUDA1: 12GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 12268MB)260621-06:23:11 (UTC+8)
29184CUDA0: 7GB / 48GB 86% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 11350MB)260621-06:21:37 (UTC+8)
29183CUDA0: 7GB / 48GB 86% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 11350MB)260621-06:20:02 (UTC+8)
29182CUDA0: 7GB / 48GB 85% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 11350MB)260621-06:18:28 (UTC+8)
29181CUDA0: 7GB / 48GB 84% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[368385] 5802MB | CUDA1 PID:[1529811] 10496MB)260621-06:16:53 (UTC+8)
29180CUDA0: 2GB / 48GB 0% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA1 PID:[1529811] 10496MB)260621-06:15:19 (UTC+8)
29179CUDA0: 7GB / 48GB 97% || CUDA1: 10GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 10496MB)260621-06:13:45 (UTC+8)
29178CUDA0: 7GB / 48GB 84% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 11454MB)260621-06:12:10 (UTC+8)
29177CUDA0: 7GB / 48GB 91% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 11454MB)260621-06:10:36 (UTC+8)
29176CUDA0: 7GB / 48GB 82% || CUDA1: 11GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 11454MB)260621-06:09:01 (UTC+8)
29175CUDA0: 7GB / 48GB 83% || CUDA1: 11GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 11454MB)260621-06:07:27 (UTC+8)
29174CUDA0: 7GB / 48GB 85% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 11454MB)260621-06:05:52 (UTC+8)
29173CUDA0: 7GB / 48GB 84% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 11454MB)260621-06:04:18 (UTC+8)
29172CUDA0: 7GB / 48GB 90% || CUDA1: 9GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 9678MB)260621-05:59:25 (UTC+8)
29171CUDA0: 7GB / 48GB 84% || CUDA1: 9GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[319601] 5802MB | CUDA1 PID:[1529811] 8846MB)260621-05:57:51 (UTC+8)
29170CUDA0: 7GB / 48GB 86% || CUDA1: 9GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 8846MB)260621-05:56:16 (UTC+8)
29169CUDA0: 7GB / 48GB 93% || CUDA1: 12GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 12306MB)260621-05:54:42 (UTC+8)
29168CUDA0: 7GB / 48GB 86% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:53:07 (UTC+8)
29167CUDA0: 7GB / 48GB 83% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:51:33 (UTC+8)
29166CUDA0: 7GB / 48GB 81% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:49:58 (UTC+8)
29165CUDA0: 16GB / 48GB 100% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[277195] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:48:24 (UTC+8)
29164CUDA0: 16GB / 48GB 100% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[277195] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:46:49 (UTC+8)
29163CUDA0: 16GB / 48GB 99% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[277195] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:45:15 (UTC+8)
29162CUDA0: 16GB / 48GB 100% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[277195] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11394MB)260621-05:43:41 (UTC+8)
29161CUDA0: 17GB / 48GB 100% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[254933] 9476MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 9666MB | CUDA1 PID:[252841] 9376MB)260621-05:42:06 (UTC+8)
29160CUDA0: 17GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[254933] 9476MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[252841] 9376MB | CUDA1 PID:[1529811] 8846MB)260621-05:40:32 (UTC+8)
29159CUDA0: 17GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[254933] 9476MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[252841] 9376MB | CUDA1 PID:[1529811] 8846MB)260621-05:38:57 (UTC+8)
29158CUDA0: 17GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[254933] 9476MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[252841] 9376MB | CUDA1 PID:[1529811] 8846MB)260621-05:37:23 (UTC+8)
29157CUDA0: 16GB / 48GB 100% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[254933] 9256MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[1529811] 11570MB | CUDA1 PID:[252841] 9376MB)260621-05:35:48 (UTC+8)
29156CUDA0: 16GB / 48GB 99% || CUDA1: 24GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[233869] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[232021] 12996MB | CUDA1 PID:[1529811] 11570MB)260621-05:34:14 (UTC+8)
29155CUDA0: 16GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[233869] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[232021] 12996MB | CUDA1 PID:[1529811] 11570MB)260621-05:32:39 (UTC+8)
29154CUDA0: 16GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[233869] 9376MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[232021] 12996MB | CUDA1 PID:[1529811] 11570MB)260621-05:31:05 (UTC+8)
29153CUDA0: 16GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[233869] 9256MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[232021] 24458MB | CUDA1 PID:[1529811] 11570MB)260621-05:29:30 (UTC+8)
29152CUDA0: 19GB / 48GB 99% || CUDA1: 34GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[217740] 11838MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[211615] 23036MB | CUDA1 PID:[1529811] 11570MB)260621-05:27:56 (UTC+8)
29151CUDA0: 19GB / 48GB 99% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[217740] 11838MB | CUDA0 PID:[225024] 5724MB | CUDA1 PID:[211615] 14196MB | CUDA1 PID:[1529811] 11570MB)260621-05:26:21 (UTC+8)
29150CUDA0: 13GB / 48GB 48% || CUDA1: 30GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[217740] 11838MB | CUDA1 PID:[211615] 19918MB | CUDA1 PID:[1529811] 10604MB)260621-05:24:47 (UTC+8)
29149CUDA0: 2GB / 48GB 0% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA1 PID:[211615] 26356MB | CUDA1 PID:[1529811] 10604MB)260621-05:23:13 (UTC+8)
29148CUDA0: 25GB / 48GB 54% || CUDA1: 20GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[201126] 23556MB | CUDA1 PID:[1529811] 10604MB | CUDA1 PID:[211615] 9676MB)260621-05:21:38 (UTC+8)
29147CUDA0: 35GB / 48GB 48% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[201126] 33656MB | CUDA1 PID:[187570] 35996MB | CUDA1 PID:[1529811] 10604MB)260621-05:20:04 (UTC+8)
29146CUDA0: 11GB / 48GB 0% || CUDA1: 28GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[201126] 9676MB | CUDA1 PID:[187570] 18576MB | CUDA1 PID:[1529811] 9696MB)260621-05:18:29 (UTC+8)
29145CUDA0: 13GB / 48GB 100% || CUDA1: 39GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[182387] 11840MB | CUDA1 PID:[187570] 29998MB | CUDA1 PID:[1529811] 9696MB)260621-05:16:55 (UTC+8)
29144CUDA0: 13GB / 48GB 0% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[182387] 11840MB | CUDA1 PID:[187570] 13616MB | CUDA1 PID:[1529811] 9696MB)260621-05:15:20 (UTC+8)
29143CUDA0: 12GB / 48GB 68% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[182387] 10836MB | CUDA1 PID:[166094] 12036MB | CUDA1 PID:[1529811] 9696MB)260621-05:13:46 (UTC+8)
29142CUDA0: 26GB / 48GB 48% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[166156] 25218MB | CUDA1 PID:[166094] 12036MB | CUDA1 PID:[1529811] 9696MB)260621-05:12:11 (UTC+8)
29141CUDA0: 41GB / 48GB 48% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[166156] 40518MB | CUDA1 PID:[166094] 34476MB | CUDA1 PID:[1529811] 9696MB)260621-05:10:37 (UTC+8)
29140CUDA0: 19GB / 48GB 46% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[166156] 17596MB | CUDA1 PID:[166094] 15556MB | CUDA1 PID:[1529811] 9696MB)260621-05:09:02 (UTC+8)
29139CUDA0: 45GB / 48GB 80% || CUDA1: 21GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[152697] 44594MB | CUDA1 PID:[148150] 11812MB | CUDA1 PID:[1529811] 9696MB)260621-05:07:28 (UTC+8)
29138CUDA0: 30GB / 48GB 50% || CUDA1: 21GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[152697] 28730MB | CUDA1 PID:[148150] 11812MB | CUDA1 PID:[1529811] 9696MB)260621-05:05:53 (UTC+8)
29137CUDA0: 14GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[152697] 12370MB | CUDA1 PID:[148150] 11808MB | CUDA1 PID:[1529811] 11342MB)260621-05:04:19 (UTC+8)
29136CUDA0: 38GB / 48GB 2% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[141763] 37432MB | CUDA1 PID:[1529811] 11342MB | CUDA1 PID:[148150] 10828MB)260621-05:02:44 (UTC+8)
29135CUDA0: 24GB / 48GB 56% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[141763] 22772MB | CUDA1 PID:[129945] 14046MB | CUDA1 PID:[1529811] 11342MB)260621-05:01:10 (UTC+8)
29134CUDA0: 11GB / 48GB 77% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[122859] 9916MB | CUDA1 PID:[129945] 29750MB | CUDA1 PID:[1529811] 11342MB)260621-04:59:35 (UTC+8)
29133CUDA0: 11GB / 48GB 78% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[122859] 9916MB | CUDA1 PID:[129945] 19450MB | CUDA1 PID:[1529811] 10500MB)260621-04:58:01 (UTC+8)
29132CUDA0: 11GB / 48GB 89% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[122859] 9916MB | CUDA1 PID:[129945] 10584MB | CUDA1 PID:[1529811] 10500MB)260621-04:56:27 (UTC+8)
29131CUDA0: 11GB / 48GB 82% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[122859] 9896MB | CUDA1 PID:[1529811] 10500MB | CUDA1 PID:[97633] 9956MB)260621-04:54:52 (UTC+8)
29130CUDA0: 11GB / 48GB 85% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[102989] 9936MB | CUDA1 PID:[1529811] 10500MB | CUDA1 PID:[97633] 9956MB)260621-04:53:18 (UTC+8)
29129CUDA0: 11GB / 48GB 91% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[102989] 9936MB | CUDA1 PID:[1529811] 10500MB | CUDA1 PID:[97633] 9956MB)260621-04:51:43 (UTC+8)
29128CUDA0: 11GB / 48GB 100% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[102989] 9936MB | CUDA1 PID:[1529811] 10500MB | CUDA1 PID:[97633] 9956MB)260621-04:50:09 (UTC+8)
29127CUDA0: 11GB / 48GB 71% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[102989] 9896MB | CUDA1 PID:[1529811] 10500MB | CUDA1 PID:[97633] 9916MB)260621-04:48:34 (UTC+8)
29126CUDA0: 11GB / 48GB 65% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[86258] 9956MB | CUDA1 PID:[97633] 9896MB | CUDA1 PID:[1529811] 9660MB)260621-04:47:00 (UTC+8)
29125CUDA0: 11GB / 48GB 83% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[86258] 9956MB | CUDA1 PID:[71959] 9676MB | CUDA1 PID:[1529811] 9660MB)260621-04:45:25 (UTC+8)
29124CUDA0: 11GB / 48GB 82% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[86258] 9956MB | CUDA1 PID:[71959] 9676MB | CUDA1 PID:[1529811] 9660MB)260621-04:43:51 (UTC+8)
29123CUDA0: 11GB / 48GB 91% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[86258] 9936MB | CUDA1 PID:[71959] 9676MB | CUDA1 PID:[1529811] 9660MB)260621-04:42:16 (UTC+8)
29122CUDA0: 11GB / 48GB 81% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[71568] 9616MB | CUDA1 PID:[71959] 9676MB | CUDA1 PID:[1529811] 9660MB)260621-04:40:42 (UTC+8)
29121CUDA0: 11GB / 48GB 84% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[71568] 9616MB | CUDA1 PID:[71959] 9676MB | CUDA1 PID:[1529811] 9660MB)260621-04:39:07 (UTC+8)
29120CUDA0: 11GB / 48GB 81% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[71568] 9616MB | CUDA1 PID:[71959] 9536MB | CUDA1 PID:[1529811] 8848MB)260621-04:37:33 (UTC+8)
29119CUDA0: 11GB / 48GB 94% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[56502] 9676MB | CUDA1 PID:[46332] 9636MB | CUDA1 PID:[1529811] 8846MB)260621-04:35:59 (UTC+8)
29118CUDA0: 11GB / 48GB 81% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[56502] 9676MB | CUDA1 PID:[46332] 9636MB | CUDA1 PID:[1529811] 8846MB)260621-04:34:24 (UTC+8)
29117CUDA0: 11GB / 48GB 85% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[56502] 9676MB | CUDA1 PID:[46332] 9636MB | CUDA1 PID:[1529811] 8846MB)260621-04:32:50 (UTC+8)
29116CUDA0: 11GB / 48GB 91% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[56502] 9536MB | CUDA1 PID:[1529811] 12418MB | CUDA1 PID:[46332] 9636MB)260621-04:31:15 (UTC+8)
29115CUDA0: 11GB / 48GB 79% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[46332] 9636MB)260621-04:29:41 (UTC+8)
29114CUDA0: 11GB / 48GB 72% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[46332] 9596MB)260621-04:28:06 (UTC+8)
29113CUDA0: 11GB / 48GB 86% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[4150823] 9796MB)260621-04:26:32 (UTC+8)
29112CUDA0: 11GB / 48GB 72% || CUDA1: 21GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[4150823] 9796MB)260621-04:24:57 (UTC+8)
29111CUDA0: 11GB / 48GB 93% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[4150823] 9796MB)260621-04:23:23 (UTC+8)
29110CUDA0: 11GB / 48GB 86% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[4150823] 9796MB)260621-04:21:48 (UTC+8)
29109CUDA0: 11GB / 48GB 81% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 10540MB | CUDA1 PID:[4150823] 9796MB)260621-04:20:14 (UTC+8)
29108CUDA0: 11GB / 48GB 87% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 10540MB | CUDA1 PID:[4150823] 9796MB)260621-04:18:39 (UTC+8)
29107CUDA0: 11GB / 48GB 81% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 10540MB | CUDA1 PID:[4150823] 9796MB)260621-04:17:05 (UTC+8)
29106CUDA0: 11GB / 48GB 82% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9756MB | CUDA1 PID:[1529811] 10540MB | CUDA1 PID:[4150823] 9796MB)260621-04:15:30 (UTC+8)
29105CUDA0: 11GB / 48GB 82% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[9726] 9656MB | CUDA1 PID:[4150823] 9796MB | CUDA1 PID:[1529811] 9648MB)260621-04:13:56 (UTC+8)
29104CUDA0: 11GB / 48GB 50% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9796MB | CUDA1 PID:[1529811] 9648MB)260621-04:12:21 (UTC+8)
29103CUDA0: 11GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9796MB | CUDA1 PID:[1529811] 8846MB)260621-04:10:47 (UTC+8)
29102CUDA0: 11GB / 48GB 97% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9796MB | CUDA1 PID:[1529811] 8846MB)260621-04:09:12 (UTC+8)
29101CUDA0: 11GB / 48GB 83% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9796MB | CUDA1 PID:[1529811] 8846MB)260621-04:07:38 (UTC+8)
29100CUDA0: 11GB / 48GB 92% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9796MB | CUDA1 PID:[1529811] 8846MB)260621-04:06:03 (UTC+8)
29099CUDA0: 11GB / 48GB 85% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9696MB | CUDA1 PID:[1529811] 8846MB)260621-04:04:29 (UTC+8)
29098CUDA0: 11GB / 48GB 87% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9696MB | CUDA1 PID:[1529811] 8846MB)260621-04:02:54 (UTC+8)
29097CUDA0: 11GB / 48GB 66% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9696MB | CUDA1 PID:[1529811] 8846MB)260621-04:01:20 (UTC+8)
29096CUDA0: 11GB / 48GB 87% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9696MB | CUDA1 PID:[1529811] 8846MB)260621-03:59:46 (UTC+8)
29095CUDA0: 11GB / 48GB 88% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[4150823] 9656MB | CUDA1 PID:[1529811] 8846MB)260621-03:58:11 (UTC+8)
29094CUDA0: 11GB / 48GB 73% || CUDA1: 20GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[4148413] 9756MB | CUDA1 PID:[1529811] 11498MB | CUDA1 PID:[4150823] 9032MB)260621-03:56:37 (UTC+8)
29093CUDA0: 11GB / 48GB 92% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11498MB | CUDA1 PID:[4062460] 9876MB)260621-03:55:02 (UTC+8)
29092CUDA0: 11GB / 48GB 79% || CUDA1: 21GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:53:28 (UTC+8)
29091CUDA0: 11GB / 48GB 87% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:51:53 (UTC+8)
29090CUDA0: 11GB / 48GB 81% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:50:19 (UTC+8)
29089CUDA0: 11GB / 48GB 70% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:48:44 (UTC+8)
29088CUDA0: 11GB / 48GB 85% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:47:10 (UTC+8)
29087CUDA0: 11GB / 48GB 81% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9776MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:45:35 (UTC+8)
29086CUDA0: 11GB / 48GB 69% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9696MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:44:01 (UTC+8)
29085CUDA0: 11GB / 48GB 89% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9696MB | CUDA1 PID:[1529811] 11496MB | CUDA1 PID:[4062460] 9876MB)260621-03:42:27 (UTC+8)
29084CUDA0: 11GB / 48GB 80% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9696MB | CUDA1 PID:[1529811] 11494MB | CUDA1 PID:[4062460] 9876MB)260621-03:40:52 (UTC+8)
29083CUDA0: 11GB / 48GB 88% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4092643] 9696MB | CUDA1 PID:[1529811] 11494MB | CUDA1 PID:[4062460] 9876MB)260621-03:39:18 (UTC+8)
29082CUDA0: 11GB / 48GB 79% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9876MB | CUDA1 PID:[1529811] 11494MB | CUDA1 PID:[4062460] 9876MB)260621-03:37:43 (UTC+8)
29081CUDA0: 11GB / 48GB 77% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9876MB | CUDA1 PID:[1529811] 10516MB | CUDA1 PID:[4062460] 9876MB)260621-03:36:09 (UTC+8)
29080CUDA0: 11GB / 48GB 90% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9876MB | CUDA1 PID:[1529811] 10516MB | CUDA1 PID:[4062460] 9836MB)260621-03:34:34 (UTC+8)
29079CUDA0: 11GB / 48GB 80% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9876MB | CUDA1 PID:[1529811] 10516MB | CUDA1 PID:[4062460] 9836MB)260621-03:33:00 (UTC+8)
29078CUDA0: 11GB / 48GB 96% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9876MB | CUDA1 PID:[1529811] 10516MB | CUDA1 PID:[4062460] 9836MB)260621-03:31:25 (UTC+8)
29077CUDA0: 11GB / 48GB 80% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9876MB | CUDA1 PID:[1529811] 10516MB | CUDA1 PID:[4062460] 9836MB)260621-03:29:51 (UTC+8)
29076CUDA0: 11GB / 48GB 60% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9856MB | CUDA1 PID:[4062460] 9836MB | CUDA1 PID:[1529811] 9636MB)260621-03:28:16 (UTC+8)
29075CUDA0: 11GB / 48GB 82% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9856MB | CUDA1 PID:[3868015] 18234MB | CUDA1 PID:[1529811] 9636MB)260621-03:26:42 (UTC+8)
29074CUDA0: 11GB / 48GB 78% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9856MB | CUDA1 PID:[3868015] 18234MB | CUDA1 PID:[1529811] 8846MB)260621-03:25:07 (UTC+8)
29073CUDA0: 11GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9816MB | CUDA1 PID:[3868015] 18234MB | CUDA1 PID:[1529811] 10686MB)260621-03:23:33 (UTC+8)
29072CUDA0: 11GB / 48GB 83% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[4043894] 9796MB | CUDA1 PID:[3868015] 31076MB | CUDA1 PID:[1529811] 10686MB)260621-03:21:58 (UTC+8)
29071CUDA0: 11GB / 48GB 56% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 25478MB | CUDA1 PID:[1529811] 10686MB)260621-03:20:24 (UTC+8)
29070CUDA0: 11GB / 48GB 87% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 18988MB | CUDA1 PID:[1529811] 10686MB)260621-03:18:49 (UTC+8)
29069CUDA0: 11GB / 48GB 74% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 29776MB | CUDA1 PID:[1529811] 10686MB)260621-03:17:15 (UTC+8)
29068CUDA0: 11GB / 48GB 75% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 24376MB | CUDA1 PID:[1529811] 10684MB)260621-03:15:40 (UTC+8)
29067CUDA0: 11GB / 48GB 80% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 23298MB | CUDA1 PID:[1529811] 10684MB)260621-03:14:06 (UTC+8)
29066CUDA0: 11GB / 48GB 84% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 30816MB | CUDA1 PID:[1529811] 10684MB)260621-03:12:31 (UTC+8)
29065CUDA0: 11GB / 48GB 88% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 27158MB | CUDA1 PID:[1529811] 9726MB)260621-03:10:57 (UTC+8)
29064CUDA0: 11GB / 48GB 86% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9856MB | CUDA1 PID:[3868015] 21196MB | CUDA1 PID:[1529811] 9726MB)260621-03:09:22 (UTC+8)
29063CUDA0: 11GB / 48GB 86% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9836MB | CUDA1 PID:[3868015] 14322MB | CUDA1 PID:[1529811] 9726MB)260621-03:07:48 (UTC+8)
29062CUDA0: 11GB / 48GB 83% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3997533] 9836MB | CUDA1 PID:[3868015] 36042MB | CUDA1 PID:[1529811] 10548MB)260621-03:06:13 (UTC+8)
29061CUDA0: 11GB / 48GB 87% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 25438MB | CUDA1 PID:[1529811] 10548MB)260621-03:04:39 (UTC+8)
29060CUDA0: 11GB / 48GB 82% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 18806MB | CUDA1 PID:[1529811] 10548MB)260621-03:03:04 (UTC+8)
29059CUDA0: 11GB / 48GB 85% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 37238MB | CUDA1 PID:[1529811] 10548MB)260621-03:01:30 (UTC+8)
29058CUDA0: 11GB / 48GB 85% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 32360MB | CUDA1 PID:[1529811] 10548MB)260621-02:59:55 (UTC+8)
29057CUDA0: 11GB / 48GB 81% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 25456MB | CUDA1 PID:[1529811] 10548MB)260621-02:58:21 (UTC+8)
29056CUDA0: 11GB / 48GB 69% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 19514MB | CUDA1 PID:[1529811] 10548MB)260621-02:56:47 (UTC+8)
29055CUDA0: 11GB / 48GB 98% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9896MB | CUDA1 PID:[3868015] 35738MB | CUDA1 PID:[1529811] 9686MB)260621-02:55:12 (UTC+8)
29054CUDA0: 11GB / 48GB 83% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9856MB | CUDA1 PID:[3868015] 35378MB | CUDA1 PID:[1529811] 9686MB)260621-02:53:38 (UTC+8)
29053CUDA0: 11GB / 48GB 68% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9856MB | CUDA1 PID:[3868015] 35378MB | CUDA1 PID:[1529811] 9686MB)260621-02:52:03 (UTC+8)
29052CUDA0: 11GB / 48GB 81% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9856MB | CUDA1 PID:[3868015] 22298MB | CUDA1 PID:[1529811] 9686MB)260621-02:50:29 (UTC+8)
29051CUDA0: 11GB / 48GB 82% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3952627] 9776MB | CUDA1 PID:[3868015] 16088MB | CUDA1 PID:[1529811] 8846MB)260621-02:48:54 (UTC+8)
29050CUDA0: 34GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33022MB | CUDA1 PID:[3868015] 36858MB | CUDA1 PID:[1529811] 8846MB)260621-02:47:20 (UTC+8)
29049CUDA0: 34GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33022MB | CUDA1 PID:[3868015] 33578MB | CUDA1 PID:[1529811] 8846MB)260621-02:45:45 (UTC+8)
29048CUDA0: 34GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33022MB | CUDA1 PID:[3868015] 29898MB | CUDA1 PID:[1529811] 8846MB)260621-02:44:11 (UTC+8)
29047CUDA0: 34GB / 48GB 12% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33022MB | CUDA1 PID:[3868015] 19956MB | CUDA1 PID:[1529811] 11504MB)260621-02:42:36 (UTC+8)
29046CUDA0: 34GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33022MB | CUDA1 PID:[3868015] 36922MB | CUDA1 PID:[1529811] 11504MB)260621-02:41:02 (UTC+8)
29045CUDA0: 34GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33022MB | CUDA1 PID:[3868015] 28898MB | CUDA1 PID:[1529811] 11504MB)260621-02:39:27 (UTC+8)
29044CUDA0: 34GB / 48GB 94% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 28378MB | CUDA1 PID:[1529811] 11504MB)260621-02:37:53 (UTC+8)
29043CUDA0: 34GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 26938MB | CUDA1 PID:[1529811] 11504MB)260621-02:36:19 (UTC+8)
29042CUDA0: 34GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 26938MB | CUDA1 PID:[1529811] 11504MB)260621-02:34:44 (UTC+8)
29041CUDA0: 34GB / 48GB 93% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 20934MB | CUDA1 PID:[1529811] 11504MB)260621-02:33:10 (UTC+8)
29040CUDA0: 34GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 35736MB | CUDA1 PID:[1529811] 11504MB)260621-02:31:35 (UTC+8)
29039CUDA0: 34GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 32340MB | CUDA1 PID:[1529811] 10568MB)260621-02:30:01 (UTC+8)
29038CUDA0: 34GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 32338MB | CUDA1 PID:[1529811] 10568MB)260621-02:28:26 (UTC+8)
29037CUDA0: 34GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 28898MB | CUDA1 PID:[1529811] 10568MB)260621-02:26:52 (UTC+8)
29036CUDA0: 34GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 28898MB | CUDA1 PID:[1529811] 10568MB)260621-02:25:17 (UTC+8)
29035CUDA0: 34GB / 48GB 100% || CUDA1: 36GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 33020MB | CUDA1 PID:[3868015] 25938MB | CUDA1 PID:[1529811] 10568MB)260621-02:23:43 (UTC+8)
29034CUDA0: 24GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 22900MB | CUDA1 PID:[3868015] 22638MB | CUDA1 PID:[1529811] 10568MB)260621-02:22:08 (UTC+8)
29033CUDA0: 21GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 20198MB | CUDA1 PID:[3868015] 19698MB | CUDA1 PID:[1529811] 10568MB)260621-02:20:34 (UTC+8)
29032CUDA0: 47GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 46458MB | CUDA1 PID:[3868015] 23294MB | CUDA1 PID:[1529811] 10568MB)260621-02:18:59 (UTC+8)
29031CUDA0: 40GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 38878MB | CUDA1 PID:[3868015] 15900MB | CUDA1 PID:[1529811] 10568MB)260621-02:17:25 (UTC+8)
29030CUDA0: 21GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 19526MB | CUDA1 PID:[3670582] 29536MB | CUDA1 PID:[1529811] 10568MB)260621-02:15:50 (UTC+8)
29029CUDA0: 30GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 29338MB | CUDA1 PID:[3670582] 29536MB | CUDA1 PID:[1529811] 10568MB)260621-02:14:16 (UTC+8)
29028CUDA0: 43GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 42198MB | CUDA1 PID:[3670582] 29536MB | CUDA1 PID:[1529811] 9704MB)260621-02:12:41 (UTC+8)
29027CUDA0: 15GB / 48GB 95% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3847807] 14042MB | CUDA1 PID:[3670582] 38436MB | CUDA1 PID:[1529811] 9704MB)260621-02:11:07 (UTC+8)
29026CUDA0: 19GB / 48GB 65% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 17254MB | CUDA1 PID:[3670582] 32258MB | CUDA1 PID:[1529811] 9704MB)260621-02:09:32 (UTC+8)
29025CUDA0: 19GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 17254MB | CUDA1 PID:[3670582] 24076MB | CUDA1 PID:[1529811] 9704MB)260621-02:07:58 (UTC+8)
29024CUDA0: 43GB / 48GB 100% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 42000MB | CUDA1 PID:[3670582] 19134MB | CUDA1 PID:[1529811] 8846MB)260621-02:06:23 (UTC+8)
29023CUDA0: 46GB / 48GB 87% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 45462MB | CUDA1 PID:[3670582] 36958MB | CUDA1 PID:[1529811] 10624MB)260621-02:04:49 (UTC+8)
29022CUDA0: 22GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 21238MB | CUDA1 PID:[3670582] 31818MB | CUDA1 PID:[1529811] 10624MB)260621-02:03:14 (UTC+8)
29021CUDA0: 29GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 28174MB | CUDA1 PID:[3670582] 23594MB | CUDA1 PID:[1529811] 10624MB)260621-02:01:39 (UTC+8)
29020CUDA0: 38GB / 48GB 91% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 37016MB | CUDA1 PID:[3670582] 16626MB | CUDA1 PID:[1529811] 10624MB)260621-02:00:05 (UTC+8)
29019CUDA0: 44GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 43598MB | CUDA1 PID:[3670582] 33678MB | CUDA1 PID:[1529811] 10624MB)260621-01:58:31 (UTC+8)
29018CUDA0: 17GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 15626MB | CUDA1 PID:[3670582] 25436MB | CUDA1 PID:[1529811] 10624MB)260621-01:56:56 (UTC+8)
29017CUDA0: 40GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 38842MB | CUDA1 PID:[3670582] 17806MB | CUDA1 PID:[1529811] 10624MB)260621-01:55:22 (UTC+8)
29016CUDA0: 19GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 17602MB | CUDA1 PID:[3670582] 36480MB | CUDA1 PID:[1529811] 10624MB)260621-01:53:47 (UTC+8)
29015CUDA0: 25GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 23814MB | CUDA1 PID:[3670582] 28936MB | CUDA1 PID:[1529811] 10624MB)260621-01:52:13 (UTC+8)
29014CUDA0: 33GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 31542MB | CUDA1 PID:[3670582] 20564MB | CUDA1 PID:[1529811] 10624MB)260621-01:50:38 (UTC+8)
29013CUDA0: 37GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 36496MB | CUDA1 PID:[3670582] 37678MB | CUDA1 PID:[1529811] 10624MB)260621-01:49:04 (UTC+8)
29012CUDA0: 46GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 45820MB | CUDA1 PID:[3670582] 23898MB | CUDA1 PID:[1529811] 10624MB)260621-01:47:29 (UTC+8)
29011CUDA0: 19GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 17656MB | CUDA1 PID:[3670582] 23716MB | CUDA1 PID:[1529811] 10624MB)260621-01:45:55 (UTC+8)
29010CUDA0: 28GB / 48GB 100% || CUDA1: 23GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 26598MB | CUDA1 PID:[3670582] 12486MB | CUDA1 PID:[1529811] 10624MB)260621-01:44:20 (UTC+8)
29009CUDA0: 37GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 36056MB | CUDA1 PID:[3670582] 33598MB | CUDA1 PID:[1529811] 10624MB)260621-01:42:46 (UTC+8)
29008CUDA0: 43GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 42258MB | CUDA1 PID:[3670582] 24194MB | CUDA1 PID:[1529811] 10624MB)260621-01:41:11 (UTC+8)
29007CUDA0: 16GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 14202MB | CUDA1 PID:[3670582] 17702MB | CUDA1 PID:[1529811] 10624MB)260621-01:39:37 (UTC+8)
29006CUDA0: 24GB / 48GB 89% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 22914MB | CUDA1 PID:[3670582] 37336MB | CUDA1 PID:[1529811] 10624MB)260621-01:38:02 (UTC+8)
29005CUDA0: 32GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 30582MB | CUDA1 PID:[3670582] 30236MB | CUDA1 PID:[1529811] 10624MB)260621-01:36:28 (UTC+8)
29004CUDA0: 40GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 38836MB | CUDA1 PID:[3670582] 21836MB | CUDA1 PID:[1529811] 10624MB)260621-01:34:53 (UTC+8)
29003CUDA0: 44GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 43522MB | CUDA1 PID:[3670582] 36878MB | CUDA1 PID:[1529811] 10624MB)260621-01:33:19 (UTC+8)
29002CUDA0: 33GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 24376MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3670582] 30874MB | CUDA1 PID:[1529811] 10624MB)260621-01:31:44 (UTC+8)
29001CUDA0: 28GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3740973] 14068MB | CUDA0 PID:[1529776] 12520MB | CUDA1 PID:[3670582] 22938MB | CUDA1 PID:[1529811] 10624MB)260621-01:30:10 (UTC+8)
29000CUDA0: 47GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 33538MB | CUDA0 PID:[1529776] 12520MB | CUDA1 PID:[3670582] 14062MB | CUDA1 PID:[1529811] 8846MB)260621-01:28:35 (UTC+8)
28999CUDA0: 47GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 33538MB | CUDA0 PID:[1529776] 12520MB | CUDA1 PID:[3670582] 37578MB | CUDA1 PID:[1529811] 8846MB)260621-01:27:01 (UTC+8)
28998CUDA0: 46GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 33538MB | CUDA0 PID:[1529776] 11560MB | CUDA1 PID:[3670582] 32102MB | CUDA1 PID:[1529811] 10550MB)260621-01:25:26 (UTC+8)
28997CUDA0: 45GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 33538MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 22238MB | CUDA1 PID:[1529811] 10550MB)260621-01:23:52 (UTC+8)
28996CUDA0: 42GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 30676MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 11842MB | CUDA1 PID:[1529811] 10550MB)260621-01:22:17 (UTC+8)
28995CUDA0: 44GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32458MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 32898MB | CUDA1 PID:[1529811] 10550MB)260621-01:20:43 (UTC+8)
28994CUDA0: 35GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23502MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 25722MB | CUDA1 PID:[1529811] 10550MB)260621-01:19:08 (UTC+8)
28993CUDA0: 47GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 35822MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 18164MB | CUDA1 PID:[1529811] 10550MB)260621-01:17:34 (UTC+8)
28992CUDA0: 40GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 28796MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 35376MB | CUDA1 PID:[1529811] 10550MB)260621-01:15:59 (UTC+8)
28991CUDA0: 44GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32342MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 27216MB | CUDA1 PID:[1529811] 10550MB)260621-01:14:25 (UTC+8)
28990CUDA0: 44GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32342MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 19948MB | CUDA1 PID:[1529811] 10550MB)260621-01:12:50 (UTC+8)
28989CUDA0: 44GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32342MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 37196MB | CUDA1 PID:[1529811] 10550MB)260621-01:11:16 (UTC+8)
28988CUDA0: 44GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32338MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 28754MB | CUDA1 PID:[1529811] 10550MB)260621-01:09:41 (UTC+8)
28987CUDA0: 44GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32338MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 21394MB | CUDA1 PID:[1529811] 10550MB)260621-01:08:07 (UTC+8)
28986CUDA0: 33GB / 48GB 100% || CUDA1: 24GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 21376MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3670582] 13930MB | CUDA1 PID:[1529811] 10550MB)260621-01:06:32 (UTC+8)
28985CUDA0: 44GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32898MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3482541] 23516MB | CUDA1 PID:[1529811] 10550MB)260621-01:04:58 (UTC+8)
28984CUDA0: 35GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23036MB | CUDA0 PID:[1529776] 10652MB | CUDA1 PID:[3482541] 23516MB | CUDA1 PID:[1529811] 10550MB)260621-01:03:23 (UTC+8)
28983CUDA0: 44GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 32616MB | CUDA0 PID:[1529776] 10650MB | CUDA1 PID:[3482541] 23516MB | CUDA1 PID:[1529811] 10550MB)260621-01:01:49 (UTC+8)
28982CUDA0: 33GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 22174MB | CUDA0 PID:[1529776] 9754MB | CUDA1 PID:[3482541] 34598MB | CUDA1 PID:[1529811] 10550MB)260621-01:00:14 (UTC+8)
28981CUDA0: 35GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23922MB | CUDA0 PID:[1529776] 9754MB | CUDA1 PID:[3482541] 26678MB | CUDA1 PID:[1529811] 10550MB)260621-00:58:40 (UTC+8)
28980CUDA0: 34GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23602MB | CUDA0 PID:[1529776] 9754MB | CUDA1 PID:[3482541] 21914MB | CUDA1 PID:[1529811] 10550MB)260621-00:57:05 (UTC+8)
28979CUDA0: 33GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23602MB | CUDA0 PID:[1529776] 8934MB | CUDA1 PID:[3482541] 36822MB | CUDA1 PID:[1529811] 9664MB)260621-00:55:31 (UTC+8)
28978CUDA0: 33GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23598MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3482541] 29462MB | CUDA1 PID:[1529811] 9664MB)260621-00:53:56 (UTC+8)
28977CUDA0: 37GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 22038MB | CUDA0 PID:[1529776] 14168MB | CUDA1 PID:[3482541] 26522MB | CUDA1 PID:[1529811] 8846MB)260621-00:52:22 (UTC+8)
28976CUDA0: 44GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 29598MB | CUDA0 PID:[1529776] 14168MB | CUDA1 PID:[3482541] 23878MB | CUDA1 PID:[1529811] 8846MB)260621-00:50:48 (UTC+8)
28975CUDA0: 33GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 17576MB | CUDA0 PID:[1529776] 14168MB | CUDA1 PID:[3482541] 23876MB | CUDA1 PID:[1529811] 8846MB)260621-00:49:13 (UTC+8)
28974CUDA0: 43GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 27856MB | CUDA0 PID:[1529776] 14168MB | CUDA1 PID:[3482541] 21156MB | CUDA1 PID:[1529811] 8846MB)260621-00:47:39 (UTC+8)
28973CUDA0: 42GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 27822MB | CUDA0 PID:[1529776] 13172MB | CUDA1 PID:[3482541] 24416MB | CUDA1 PID:[1529811] 10522MB)260621-00:46:04 (UTC+8)
28972CUDA0: 42GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 27822MB | CUDA0 PID:[1529776] 13172MB | CUDA1 PID:[3482541] 36842MB | CUDA1 PID:[1529811] 10522MB)260621-00:44:30 (UTC+8)
28971CUDA0: 41GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26862MB | CUDA0 PID:[1529776] 13172MB | CUDA1 PID:[3482541] 28402MB | CUDA1 PID:[1529811] 10522MB)260621-00:42:55 (UTC+8)
28970CUDA0: 41GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26862MB | CUDA0 PID:[1529776] 13172MB | CUDA1 PID:[3482541] 18446MB | CUDA1 PID:[1529811] 10522MB)260621-00:41:21 (UTC+8)
28969CUDA0: 41GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26862MB | CUDA0 PID:[1529776] 13172MB | CUDA1 PID:[3482541] 32982MB | CUDA1 PID:[1529811] 10522MB)260621-00:39:46 (UTC+8)
28968CUDA0: 40GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26860MB | CUDA0 PID:[1529776] 12222MB | CUDA1 PID:[3482541] 23516MB | CUDA1 PID:[1529811] 10522MB)260621-00:38:12 (UTC+8)
28967CUDA0: 40GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26860MB | CUDA0 PID:[1529776] 12222MB | CUDA1 PID:[3482541] 16466MB | CUDA1 PID:[1529811] 10522MB)260621-00:36:37 (UTC+8)
28966CUDA0: 40GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26858MB | CUDA0 PID:[1529776] 12222MB | CUDA1 PID:[3482541] 32998MB | CUDA1 PID:[1529811] 10522MB)260621-00:35:03 (UTC+8)
28965CUDA0: 40GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 26858MB | CUDA0 PID:[1529776] 12222MB | CUDA1 PID:[3482541] 19374MB | CUDA1 PID:[1529811] 10522MB)260621-00:33:28 (UTC+8)
28964CUDA0: 36GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 23456MB | CUDA0 PID:[1529776] 11358MB | CUDA1 PID:[3482541] 36722MB | CUDA1 PID:[1529811] 10522MB)260621-00:31:54 (UTC+8)
28963CUDA0: 35GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 22836MB | CUDA0 PID:[1529776] 11358MB | CUDA1 PID:[3482541] 28858MB | CUDA1 PID:[1529811] 10522MB)260621-00:30:19 (UTC+8)
28962CUDA0: 30GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 18076MB | CUDA0 PID:[1529776] 11358MB | CUDA1 PID:[3482541] 18106MB | CUDA1 PID:[1529811] 10522MB)260621-00:28:45 (UTC+8)
28961CUDA0: 29GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 16988MB | CUDA0 PID:[1529776] 11356MB | CUDA1 PID:[3482541] 36400MB | CUDA1 PID:[1529811] 10522MB)260621-00:27:10 (UTC+8)
28960CUDA0: 27GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3549098] 15224MB | CUDA0 PID:[1529776] 10494MB | CUDA1 PID:[3482541] 36400MB | CUDA1 PID:[1529811] 10522MB)260621-00:25:36 (UTC+8)
28959CUDA0: 11GB / 48GB 99% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9654MB | CUDA1 PID:[3482541] 36400MB | CUDA1 PID:[1529811] 10522MB)260621-00:24:01 (UTC+8)
28958CUDA0: 30GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 19616MB | CUDA0 PID:[1529776] 8870MB | CUDA1 PID:[3482541] 36398MB | CUDA1 PID:[1529811] 10522MB)260621-00:22:27 (UTC+8)
28957CUDA0: 30GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 19616MB | CUDA0 PID:[1529776] 8870MB | CUDA1 PID:[3482541] 33458MB | CUDA1 PID:[1529811] 10522MB)260621-00:20:52 (UTC+8)
28956CUDA0: 29GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 19616MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3482541] 33458MB | CUDA1 PID:[1529811] 10522MB)260621-00:19:18 (UTC+8)
28955CUDA0: 45GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 36582MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3482541] 33458MB | CUDA1 PID:[1529811] 9652MB)260621-00:17:43 (UTC+8)
28954CUDA0: 37GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 28016MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3482541] 29918MB | CUDA1 PID:[1529811] 9652MB)260621-00:16:09 (UTC+8)
28953CUDA0: 27GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 17384MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3482541] 29918MB | CUDA1 PID:[1529811] 9652MB)260621-00:14:34 (UTC+8)
28952CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 32698MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 29918MB | CUDA1 PID:[1529811] 9652MB)260621-00:13:00 (UTC+8)
28951CUDA0: 33GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 21474MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 29918MB | CUDA1 PID:[1529811] 9652MB)260621-00:11:25 (UTC+8)
28950CUDA0: 46GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 34356MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 29918MB | CUDA1 PID:[1529811] 9652MB)260621-00:09:51 (UTC+8)
28949CUDA0: 35GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 23014MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 29918MB | CUDA1 PID:[1529811] 9652MB)260621-00:08:16 (UTC+8)
28948CUDA0: 44GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 32838MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 25638MB | CUDA1 PID:[1529811] 9822MB)260621-00:06:42 (UTC+8)
28947CUDA0: 33GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 21624MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 23378MB | CUDA1 PID:[1529811] 9822MB)260621-00:05:07 (UTC+8)
28946CUDA0: 44GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 33056MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 21718MB | CUDA1 PID:[1529811] 9822MB)260621-00:03:33 (UTC+8)
28945CUDA0: 34GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 22574MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 28176MB | CUDA1 PID:[1529811] 9822MB)260621-00:01:58 (UTC+8)
28944CUDA0: 47GB / 48GB 100% || CUDA1: 25GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 35298MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3482541] 15698MB | CUDA1 PID:[1529811] 9822MB)260621-00:00:24 (UTC+8)
28943CUDA0: 35GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 23994MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 34958MB | CUDA1 PID:[1529811] 9822MB)260620-23:58:49 (UTC+8)
28942CUDA0: 47GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 35796MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 34958MB | CUDA1 PID:[1529811] 9822MB)260620-23:57:15 (UTC+8)
28941CUDA0: 35GB / 48GB 97% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 23258MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 34958MB | CUDA1 PID:[1529811] 9822MB)260620-23:55:40 (UTC+8)
28940CUDA0: 46GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 34698MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 16944MB | CUDA1 PID:[1529811] 9822MB)260620-23:54:05 (UTC+8)
28939CUDA0: 36GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 24756MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 35482MB | CUDA1 PID:[1529811] 9822MB)260620-23:52:31 (UTC+8)
28938CUDA0: 45GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 34098MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 25456MB | CUDA1 PID:[1529811] 9822MB)260620-23:50:56 (UTC+8)
28937CUDA0: 36GB / 48GB 100% || CUDA1: 24GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 24478MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 15102MB | CUDA1 PID:[1529811] 9822MB)260620-23:49:22 (UTC+8)
28936CUDA0: 47GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 35798MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 33396MB | CUDA1 PID:[1529811] 9822MB)260620-23:47:47 (UTC+8)
28935CUDA0: 37GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 25478MB | CUDA0 PID:[1529776] 10558MB | CUDA1 PID:[3290520] 25176MB | CUDA1 PID:[1529811] 9822MB)260620-23:46:13 (UTC+8)
28934CUDA0: 45GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 34698MB | CUDA0 PID:[1529776] 9632MB | CUDA1 PID:[3290520] 16556MB | CUDA1 PID:[1529811] 9822MB)260620-23:44:38 (UTC+8)
28933CUDA0: 36GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 25196MB | CUDA0 PID:[1529776] 9632MB | CUDA1 PID:[3290520] 33718MB | CUDA1 PID:[1529811] 9822MB)260620-23:43:04 (UTC+8)
28932CUDA0: 41GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 30898MB | CUDA0 PID:[1529776] 9632MB | CUDA1 PID:[3290520] 25662MB | CUDA1 PID:[1529811] 9822MB)260620-23:41:29 (UTC+8)
28931CUDA0: 34GB / 48GB 100% || CUDA1: 21GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 23816MB | CUDA0 PID:[1529776] 8804MB | CUDA1 PID:[3290520] 11970MB | CUDA1 PID:[1529811] 9822MB)260620-23:39:55 (UTC+8)
28930CUDA0: 47GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 37456MB | CUDA0 PID:[1529776] 8804MB | CUDA1 PID:[3290520] 33176MB | CUDA1 PID:[1529811] 9822MB)260620-23:38:20 (UTC+8)
28929CUDA0: 38GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 28114MB | CUDA0 PID:[1529776] 8804MB | CUDA1 PID:[3290520] 21016MB | CUDA1 PID:[1529811] 9822MB)260620-23:36:46 (UTC+8)
28928CUDA0: 27GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 18124MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3290520] 37498MB | CUDA1 PID:[1529811] 9816MB)260620-23:35:11 (UTC+8)
28927CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 33416MB | CUDA0 PID:[1529776] 11506MB | CUDA1 PID:[3290520] 29358MB | CUDA1 PID:[1529811] 8846MB)260620-23:33:37 (UTC+8)
28926CUDA0: 32GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 19434MB | CUDA0 PID:[1529776] 11506MB | CUDA1 PID:[3290520] 20874MB | CUDA1 PID:[1529811] 8846MB)260620-23:32:02 (UTC+8)
28925CUDA0: 43GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 30282MB | CUDA0 PID:[1529776] 11506MB | CUDA1 PID:[3290520] 37158MB | CUDA1 PID:[1529811] 8846MB)260620-23:30:28 (UTC+8)
28924CUDA0: 30GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 17004MB | CUDA0 PID:[1529776] 11506MB | CUDA1 PID:[3290520] 27396MB | CUDA1 PID:[1529811] 12258MB)260620-23:28:53 (UTC+8)
28923CUDA0: 37GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 24794MB | CUDA0 PID:[1529776] 11506MB | CUDA1 PID:[3290520] 17102MB | CUDA1 PID:[1529811] 12258MB)260620-23:27:19 (UTC+8)
28922CUDA0: 47GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 35836MB | CUDA0 PID:[1529776] 10598MB | CUDA1 PID:[3290520] 28376MB | CUDA1 PID:[1529811] 12258MB)260620-23:25:44 (UTC+8)
28921CUDA0: 37GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 25576MB | CUDA0 PID:[1529776] 10598MB | CUDA1 PID:[3290520] 17104MB | CUDA1 PID:[1529811] 12258MB)260620-23:24:10 (UTC+8)
28920CUDA0: 47GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 35402MB | CUDA0 PID:[1529776] 10598MB | CUDA1 PID:[3290520] 28576MB | CUDA1 PID:[1529811] 12258MB)260620-23:22:35 (UTC+8)
28919CUDA0: 33GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 21262MB | CUDA0 PID:[1529776] 10598MB | CUDA1 PID:[3290520] 18114MB | CUDA1 PID:[1529811] 12258MB)260620-23:21:01 (UTC+8)
28918CUDA0: 29GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3364592] 16844MB | CUDA0 PID:[1529776] 10598MB | CUDA1 PID:[3290520] 30436MB | CUDA1 PID:[1529811] 12258MB)260620-23:19:26 (UTC+8)
28917CUDA0: 11GB / 48GB 98% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 16944MB | CUDA1 PID:[1529811] 12258MB)260620-23:17:52 (UTC+8)
28916CUDA0: 46GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 35916MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 28918MB | CUDA1 PID:[1529811] 12258MB)260620-23:16:17 (UTC+8)
28915CUDA0: 46GB / 48GB 100% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 35916MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 16124MB | CUDA1 PID:[1529811] 11294MB)260620-23:14:43 (UTC+8)
28914CUDA0: 46GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 35916MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 28496MB | CUDA1 PID:[1529811] 10452MB)260620-23:13:08 (UTC+8)
28913CUDA0: 37GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 26496MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 17778MB | CUDA1 PID:[1529811] 10452MB)260620-23:11:34 (UTC+8)
28912CUDA0: 30GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 19078MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 34138MB | CUDA1 PID:[1529811] 10452MB)260620-23:10:00 (UTC+8)
28911CUDA0: 47GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 36756MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 24258MB | CUDA1 PID:[1529811] 10452MB)260620-23:08:25 (UTC+8)
28910CUDA0: 39GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 28736MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 38022MB | CUDA1 PID:[1529811] 9648MB)260620-23:06:51 (UTC+8)
28909CUDA0: 31GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 19956MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 31018MB | CUDA1 PID:[1529811] 9648MB)260620-23:05:16 (UTC+8)
28908CUDA0: 46GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 35798MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 22356MB | CUDA1 PID:[1529811] 9648MB)260620-23:03:41 (UTC+8)
28907CUDA0: 39GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 28476MB | CUDA0 PID:[1529776] 9694MB | CUDA1 PID:[3290520] 37194MB | CUDA1 PID:[1529811] 8846MB)260620-23:02:07 (UTC+8)
28906CUDA0: 31GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 21356MB | CUDA0 PID:[1529776] 8900MB | CUDA1 PID:[3290520] 28896MB | CUDA1 PID:[1529811] 8846MB)260620-23:00:32 (UTC+8)
28905CUDA0: 38GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 27136MB | CUDA0 PID:[1529776] 8900MB | CUDA1 PID:[3290520] 21566MB | CUDA1 PID:[1529811] 8846MB)260620-22:58:58 (UTC+8)
28904CUDA0: 40GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 31536MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[3290520] 36078MB | CUDA1 PID:[1529811] 8846MB)260620-22:57:24 (UTC+8)
28903CUDA0: 32GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 18894MB | CUDA0 PID:[1529776] 12388MB | CUDA1 PID:[3290520] 34136MB | CUDA1 PID:[1529811] 8846MB)260620-22:55:49 (UTC+8)
28902CUDA0: 44GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 32376MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3290520] 23996MB | CUDA1 PID:[1529811] 8846MB)260620-22:54:15 (UTC+8)
28901CUDA0: 35GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 22696MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 35876MB | CUDA1 PID:[1529811] 8846MB)260620-22:52:40 (UTC+8)
28900CUDA0: 44GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 30638MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 35876MB | CUDA1 PID:[1529811] 11536MB)260620-22:51:06 (UTC+8)
28899CUDA0: 39GB / 48GB 100% || CUDA1: 46GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 27156MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 35876MB | CUDA1 PID:[1529811] 11536MB)260620-22:49:31 (UTC+8)
28898CUDA0: 31GB / 48GB 100% || CUDA1: 46GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 18214MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 35876MB | CUDA1 PID:[1529811] 11536MB)260620-22:47:56 (UTC+8)
28897CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 32116MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 28716MB | CUDA1 PID:[1529811] 11536MB)260620-22:46:22 (UTC+8)
28896CUDA0: 33GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 20676MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 21536MB | CUDA1 PID:[1529811] 11536MB)260620-22:44:47 (UTC+8)
28895CUDA0: 46GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 33876MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[1529811] 11536MB | CUDA1 PID:[3133098] 11444MB)260620-22:43:13 (UTC+8)
28894CUDA0: 36GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 24116MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 31236MB | CUDA1 PID:[1529811] 11536MB)260620-22:41:38 (UTC+8)
28893CUDA0: 25GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 12824MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 21636MB | CUDA1 PID:[1529811] 11534MB)260620-22:40:04 (UTC+8)
28892CUDA0: 41GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 28738MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[1529811] 11534MB | CUDA1 PID:[3133098] 11264MB)260620-22:38:29 (UTC+8)
28891CUDA0: 31GB / 48GB 97% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 18736MB | CUDA0 PID:[1529776] 11388MB | CUDA1 PID:[3133098] 29616MB | CUDA1 PID:[1529811] 11534MB)260620-22:36:55 (UTC+8)
28890CUDA0: 45GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 33856MB | CUDA0 PID:[1529776] 10496MB | CUDA1 PID:[3133098] 22516MB | CUDA1 PID:[1529811] 11534MB)260620-22:35:20 (UTC+8)
28889CUDA0: 35GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 23756MB | CUDA0 PID:[1529776] 10496MB | CUDA1 PID:[3133098] 14836MB | CUDA1 PID:[1529811] 11534MB)260620-22:33:46 (UTC+8)
28888CUDA0: 26GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 14384MB | CUDA0 PID:[1529776] 10496MB | CUDA1 PID:[3133098] 31856MB | CUDA1 PID:[1529811] 11534MB)260620-22:32:12 (UTC+8)
28887CUDA0: 42GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 30876MB | CUDA0 PID:[1529776] 10496MB | CUDA1 PID:[3133098] 22816MB | CUDA1 PID:[1529811] 11534MB)260620-22:30:37 (UTC+8)
28886CUDA0: 31GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 19954MB | CUDA0 PID:[1529776] 10496MB | CUDA1 PID:[3133098] 35656MB | CUDA1 PID:[1529811] 11534MB)260620-22:29:03 (UTC+8)
28885CUDA0: 25GB / 48GB 99% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3207959] 12952MB | CUDA0 PID:[1529776] 10494MB | CUDA1 PID:[3133098] 27796MB | CUDA1 PID:[1529811] 11534MB)260620-22:27:28 (UTC+8)
28884CUDA0: 26GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 14476MB | CUDA0 PID:[1529776] 10494MB | CUDA1 PID:[3133098] 18736MB | CUDA1 PID:[1529811] 11534MB)260620-22:25:54 (UTC+8)
28883CUDA0: 25GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 14476MB | CUDA0 PID:[1529776] 9646MB | CUDA1 PID:[3133098] 31496MB | CUDA1 PID:[1529811] 10616MB)260620-22:24:19 (UTC+8)
28882CUDA0: 24GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 14476MB | CUDA0 PID:[1529776] 8836MB | CUDA1 PID:[3133098] 24916MB | CUDA1 PID:[1529811] 10616MB)260620-22:22:44 (UTC+8)
28881CUDA0: 36GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 26438MB | CUDA0 PID:[1529776] 8836MB | CUDA1 PID:[3133098] 16406MB | CUDA1 PID:[1529811] 10616MB)260620-22:21:10 (UTC+8)
28880CUDA0: 32GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 20916MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 33596MB | CUDA1 PID:[1529811] 9704MB)260620-22:19:35 (UTC+8)
28879CUDA0: 47GB / 48GB 100% || CUDA1: 33GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 36180MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 25338MB | CUDA1 PID:[1529811] 8846MB)260620-22:18:01 (UTC+8)
28878CUDA0: 39GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 28116MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 19776MB | CUDA1 PID:[1529811] 8846MB)260620-22:16:26 (UTC+8)
28877CUDA0: 31GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 19876MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 36596MB | CUDA1 PID:[1529811] 8846MB)260620-22:14:52 (UTC+8)
28876CUDA0: 44GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 33776MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 26876MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2988581] 6604MB)260620-22:13:17 (UTC+8)
28875CUDA0: 33GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 22716MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 29896MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:11:42 (UTC+8)
28874CUDA0: 25GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 13822MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 17194MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:10:08 (UTC+8)
28873CUDA0: 43GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 32476MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 25976MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:08:33 (UTC+8)
28872CUDA0: 32GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 21518MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 18484MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:06:58 (UTC+8)
28871CUDA0: 46GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 35796MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 30976MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:05:24 (UTC+8)
28870CUDA0: 36GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 25556MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 17434MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:03:49 (UTC+8)
28869CUDA0: 47GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 36856MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[3133098] 29476MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:02:15 (UTC+8)
28868CUDA0: 38GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 26936MB | CUDA0 PID:[1529776] 9808MB | CUDA1 PID:[2958794] 25856MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-22:00:40 (UTC+8)
28867CUDA0: 32GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 20896MB | CUDA0 PID:[1529776] 9804MB | CUDA1 PID:[2958794] 25856MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-21:59:06 (UTC+8)
28866CUDA0: 47GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 35816MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 25856MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-21:57:31 (UTC+8)
28865CUDA0: 35GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 23978MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 25856MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-21:55:57 (UTC+8)
28864CUDA0: 28GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 16544MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 25856MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-21:54:22 (UTC+8)
28863CUDA0: 43GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 32056MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 14556MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-21:52:48 (UTC+8)
28862CUDA0: 34GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 22754MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 23296MB | CUDA1 PID:[1529811] 10550MB | CUDA1 PID:[2988581] 6604MB)260620-21:51:13 (UTC+8)
28861CUDA0: 45GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 33656MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 30738MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:49:39 (UTC+8)
28860CUDA0: 37GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 25736MB | CUDA0 PID:[1529776] 10554MB | CUDA1 PID:[2958794] 22076MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:48:04 (UTC+8)
28859CUDA0: 40GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 29876MB | CUDA0 PID:[1529776] 9674MB | CUDA1 PID:[2958794] 23896MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:44:51 (UTC+8)
28858CUDA0: 33GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 22816MB | CUDA0 PID:[1529776] 8836MB | CUDA1 PID:[2958794] 16102MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:43:16 (UTC+8)
28857CUDA0: 46GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 36556MB | CUDA0 PID:[1529776] 8836MB | CUDA1 PID:[2958794] 26316MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:41:42 (UTC+8)
28856CUDA0: 41GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 28976MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 18924MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:40:07 (UTC+8)
28855CUDA0: 32GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3065378] 19874MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 29836MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:38:33 (UTC+8)
28854CUDA0: 22GB / 48GB 98% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11508MB | CUDA0 PID:[3065378] 9000MB | CUDA1 PID:[2958794] 22516MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:36:58 (UTC+8)
28853CUDA0: 37GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 28618MB | CUDA1 PID:[1529811] 10548MB | CUDA1 PID:[2988581] 6604MB)260620-21:35:24 (UTC+8)
28852CUDA0: 37GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 18876MB | CUDA1 PID:[1529811] 10544MB | CUDA1 PID:[2988581] 6604MB)260620-21:33:49 (UTC+8)
28851CUDA0: 37GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 30616MB | CUDA1 PID:[1529811] 9658MB | CUDA1 PID:[2988581] 6604MB)260620-21:32:14 (UTC+8)
28850CUDA0: 37GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 21336MB | CUDA1 PID:[1529811] 9658MB | CUDA1 PID:[2988581] 6604MB)260620-21:30:40 (UTC+8)
28849CUDA0: 37GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 29076MB | CUDA1 PID:[1529811] 9658MB | CUDA1 PID:[2988581] 6604MB)260620-21:29:05 (UTC+8)
28848CUDA0: 37GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 21576MB | CUDA1 PID:[1529811] 9658MB | CUDA1 PID:[2988581] 6604MB)260620-21:27:31 (UTC+8)
28847CUDA0: 37GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 29096MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2988581] 6604MB)260620-21:25:56 (UTC+8)
28846CUDA0: 37GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 18296MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2988581] 6604MB)260620-21:24:22 (UTC+8)
28845CUDA0: 37GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 11508MB | CUDA1 PID:[2958794] 23316MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2988581] 6604MB)260620-21:22:47 (UTC+8)
28844CUDA0: 36GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 10520MB | CUDA1 PID:[2958794] 24096MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2988581] 6604MB)260620-21:17:55 (UTC+8)
28843CUDA0: 36GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 10520MB | CUDA1 PID:[2958794] 22116MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2988581] 6604MB)260620-21:13:02 (UTC+8)
28842CUDA0: 36GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24978MB | CUDA0 PID:[1529776] 10520MB | CUDA1 PID:[2958794] 29916MB | CUDA1 PID:[1529811] 12272MB)260620-21:11:28 (UTC+8)
28841CUDA0: 36GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 24976MB | CUDA0 PID:[1529776] 9664MB | CUDA1 PID:[2958794] 17594MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:09:53 (UTC+8)
28840CUDA0: 33GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 22676MB | CUDA0 PID:[1529776] 9664MB | CUDA1 PID:[2958794] 21136MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:08:19 (UTC+8)
28839CUDA0: 33GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 22676MB | CUDA0 PID:[1529776] 9664MB | CUDA1 PID:[2958794] 23958MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:06:44 (UTC+8)
28838CUDA0: 32GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 22676MB | CUDA0 PID:[1529776] 8056MB | CUDA1 PID:[2958794] 28416MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:05:10 (UTC+8)
28837CUDA0: 32GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 22676MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2958794] 19354MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:03:35 (UTC+8)
28836CUDA0: 46GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 34616MB | CUDA0 PID:[1529776] 10650MB | CUDA1 PID:[2958794] 27456MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:02:01 (UTC+8)
28835CUDA0: 32GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 20856MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 27356MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-21:00:25 (UTC+8)
28834CUDA0: 47GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 35456MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 27356MB | CUDA1 PID:[1529811] 12272MB | CUDA1 PID:[2748850] 6604MB)260620-20:58:51 (UTC+8)
28833CUDA0: 37GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 25376MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 27356MB | CUDA1 PID:[1529811] 11362MB | CUDA1 PID:[2748850] 6604MB)260620-20:57:16 (UTC+8)
28832CUDA0: 26GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 13944MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 27356MB | CUDA1 PID:[1529811] 11362MB | CUDA1 PID:[2748850] 6604MB)260620-20:55:42 (UTC+8)
28831CUDA0: 39GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 27856MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 20016MB | CUDA1 PID:[1529811] 11362MB | CUDA1 PID:[2748850] 6604MB)260620-20:54:08 (UTC+8)
28830CUDA0: 42GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 30236MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 16996MB | CUDA1 PID:[1529811] 10462MB | CUDA1 PID:[2748850] 6604MB)260620-20:50:54 (UTC+8)
28829CUDA0: 30GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2921662] 17978MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 25736MB | CUDA1 PID:[1529811] 10462MB | CUDA1 PID:[2748850] 6604MB)260620-20:49:19 (UTC+8)
28828CUDA0: 36GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 24378MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 21636MB | CUDA1 PID:[1529811] 9640MB | CUDA1 PID:[2748850] 6604MB)260620-20:47:45 (UTC+8)
28827CUDA0: 36GB / 48GB 99% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 24378MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 22096MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2748850] 6604MB)260620-20:46:11 (UTC+8)
28826CUDA0: 36GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 24378MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 30356MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2748850] 6604MB)260620-20:44:36 (UTC+8)
28825CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 32638MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2788378] 24516MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2748850] 6604MB)260620-20:43:02 (UTC+8)
28824CUDA0: 36GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 25676MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 16864MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2748850] 6604MB)260620-20:41:27 (UTC+8)
28823CUDA0: 47GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 36560MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 31356MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2748850] 6604MB)260620-20:39:53 (UTC+8)
28822CUDA0: 39GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 28076MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 22156MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:38:18 (UTC+8)
28821CUDA0: 28GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 16916MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 11516MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:36:44 (UTC+8)
28820CUDA0: 45GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 34256MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 24076MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:35:09 (UTC+8)
28819CUDA0: 36GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 25178MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 13944MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:33:34 (UTC+8)
28818CUDA0: 25GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 14384MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 24996MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:31:59 (UTC+8)
28817CUDA0: 41GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 30196MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 12984MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:30:25 (UTC+8)
28816CUDA0: 32GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 21276MB | CUDA0 PID:[1529776] 9732MB | CUDA1 PID:[2788378] 24116MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:28:50 (UTC+8)
28815CUDA0: 47GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 37356MB | CUDA0 PID:[1529776] 8842MB | CUDA1 PID:[2788378] 31398MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:27:16 (UTC+8)
28814CUDA0: 41GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 29836MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 19898MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:25:41 (UTC+8)
28813CUDA0: 28GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 16894MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 31056MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:24:07 (UTC+8)
28812CUDA0: 43GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 32378MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 20556MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:22:32 (UTC+8)
28811CUDA0: 33GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 22636MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 32038MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:20:58 (UTC+8)
28810CUDA0: 47GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 36676MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 24796MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:19:24 (UTC+8)
28809CUDA0: 38GB / 48GB 100% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 27640MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 11300MB | CUDA1 PID:[1529811] 9782MB | CUDA1 PID:[2748850] 6604MB)260620-20:17:49 (UTC+8)
28808CUDA0: 26GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 15236MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 24516MB | CUDA1 PID:[1529811] 9780MB | CUDA1 PID:[2748850] 6604MB)260620-20:16:15 (UTC+8)
28807CUDA0: 43GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 32776MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 14024MB | CUDA1 PID:[1529811] 9780MB | CUDA1 PID:[2748850] 6604MB)260620-20:14:40 (UTC+8)
28806CUDA0: 30GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 19136MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 27436MB | CUDA1 PID:[1529811] 9780MB | CUDA1 PID:[2748850] 6604MB)260620-20:13:06 (UTC+8)
28805CUDA0: 46GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 35158MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 18216MB | CUDA1 PID:[1529811] 9780MB | CUDA1 PID:[2748850] 6604MB)260620-20:11:31 (UTC+8)
28804CUDA0: 34GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 23316MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 27496MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:09:57 (UTC+8)
28803CUDA0: 47GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 36476MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 15104MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:08:22 (UTC+8)
28802CUDA0: 37GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 26396MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 26174MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:06:48 (UTC+8)
28801CUDA0: 29GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 18216MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2788378] 14984MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:05:13 (UTC+8)
28800CUDA0: 41GB / 48GB 100% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 30616MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:03:38 (UTC+8)
28799CUDA0: 31GB / 48GB 100% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2778706] 20014MB | CUDA0 PID:[1529776] 9888MB | CUDA1 PID:[2628414] 11654MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:02:03 (UTC+8)
28798CUDA0: 18GB / 48GB 99% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9888MB | CUDA0 PID:[2778706] 6674MB | CUDA1 PID:[2628414] 11654MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-20:00:29 (UTC+8)
28797CUDA0: 44GB / 48GB 100% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 8944MB | CUDA1 PID:[2628414] 11654MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-19:58:54 (UTC+8)
28796CUDA0: 44GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 8944MB | CUDA1 PID:[2628414] 31936MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-19:57:20 (UTC+8)
28795CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 8944MB | CUDA1 PID:[2628414] 23556MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-19:55:45 (UTC+8)
28794CUDA0: 44GB / 48GB 99% || CUDA1: 27GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 8944MB | CUDA1 PID:[2628414] 11364MB | CUDA1 PID:[1529811] 9776MB | CUDA1 PID:[2748850] 6604MB)260620-19:54:11 (UTC+8)
28793CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 8944MB | CUDA1 PID:[2628414] 24176MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2748850] 6604MB)260620-19:52:36 (UTC+8)
28792CUDA0: 43GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2628414] 29818MB | CUDA1 PID:[1529811] 11556MB | CUDA1 PID:[2748850] 6604MB)260620-19:51:02 (UTC+8)
28791CUDA0: 45GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 16924MB | CUDA1 PID:[1529811] 11556MB)260620-19:49:27 (UTC+8)
28790CUDA0: 45GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 20674MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:47:53 (UTC+8)
28789CUDA0: 45GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 26936MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:46:18 (UTC+8)
28788CUDA0: 45GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 17016MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:44:44 (UTC+8)
28787CUDA0: 45GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 22136MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:43:09 (UTC+8)
28786CUDA0: 45GB / 48GB 99% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 27556MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:41:35 (UTC+8)
28785CUDA0: 45GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 17838MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:40:00 (UTC+8)
28784CUDA0: 45GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 30076MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:38:26 (UTC+8)
28783CUDA0: 45GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 19956MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:36:51 (UTC+8)
28782CUDA0: 45GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 28676MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:35:16 (UTC+8)
28781CUDA0: 45GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 34238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 18244MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:33:42 (UTC+8)
28780CUDA0: 44GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 32878MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 27196MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:32:07 (UTC+8)
28779CUDA0: 42GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 31238MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 11202MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:30:33 (UTC+8)
28778CUDA0: 36GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 24958MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 24016MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:28:58 (UTC+8)
28777CUDA0: 33GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 22418MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 14244MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:27:24 (UTC+8)
28776CUDA0: 33GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 22418MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 23616MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:25:49 (UTC+8)
28775CUDA0: 33GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 22418MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 25596MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:24:15 (UTC+8)
28774CUDA0: 33GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 22418MB | CUDA0 PID:[1529776] 9936MB | CUDA1 PID:[2628414] 30816MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:22:40 (UTC+8)
28773CUDA0: 33GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 22418MB | CUDA0 PID:[1529776] 9934MB | CUDA1 PID:[2628414] 22778MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:21:06 (UTC+8)
28772CUDA0: 43GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 33798MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2628414] 29976MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:19:31 (UTC+8)
28771CUDA0: 43GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 33798MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2628414] 18536MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:17:57 (UTC+8)
28770CUDA0: 40GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 31098MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2628414] 27656MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:16:22 (UTC+8)
28769CUDA0: 43GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 31098MB | CUDA0 PID:[1529776] 11574MB | CUDA1 PID:[2628414] 18416MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[2461994] 6604MB)260620-19:14:48 (UTC+8)
28768CUDA0: 33GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 20316MB | CUDA0 PID:[1529776] 11574MB | CUDA1 PID:[2628414] 28656MB | CUDA1 PID:[1529811] 9744MB | CUDA1 PID:[2461994] 6604MB)260620-19:13:13 (UTC+8)
28767CUDA0: 44GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 32116MB | CUDA0 PID:[1529776] 11574MB | CUDA1 PID:[2628414] 19116MB | CUDA1 PID:[1529811] 9744MB | CUDA1 PID:[2461994] 6604MB)260620-19:11:39 (UTC+8)
28766CUDA0: 44GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 32116MB | CUDA0 PID:[1529776] 11574MB | CUDA1 PID:[2628414] 29516MB | CUDA1 PID:[1529811] 9744MB | CUDA1 PID:[2461994] 6604MB)260620-19:10:04 (UTC+8)
28765CUDA0: 43GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 32116MB | CUDA0 PID:[1529776] 10612MB | CUDA1 PID:[2628414] 21656MB | CUDA1 PID:[1529811] 9744MB | CUDA1 PID:[2461994] 6604MB)260620-19:08:30 (UTC+8)
28764CUDA0: 40GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2624323] 28676MB | CUDA0 PID:[1529776] 10612MB | CUDA1 PID:[2628414] 12572MB | CUDA1 PID:[1529811] 9744MB | CUDA1 PID:[2461994] 6604MB)260620-19:06:55 (UTC+8)
28763CUDA0: 12GB / 48GB 98% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10612MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-19:05:21 (UTC+8)
28762CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 10612MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-19:03:46 (UTC+8)
28761CUDA0: 42GB / 48GB 99% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 10612MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-19:02:12 (UTC+8)
28760CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 10612MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-19:00:37 (UTC+8)
28759CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:59:03 (UTC+8)
28758CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:57:28 (UTC+8)
28757CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:55:54 (UTC+8)
28756CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:54:19 (UTC+8)
28755CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:52:45 (UTC+8)
28754CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:51:10 (UTC+8)
28753CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9698MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:49:36 (UTC+8)
28752CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 8834MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:48:01 (UTC+8)
28751CUDA0: 40GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 8056MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:46:27 (UTC+8)
28750CUDA0: 40GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 8056MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:44:52 (UTC+8)
28749CUDA0: 40GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 8056MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:43:18 (UTC+8)
28748CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 8964MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:41:43 (UTC+8)
28747CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11354MB | CUDA1 PID:[2461994] 6604MB)260620-18:40:09 (UTC+8)
28746CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:38:34 (UTC+8)
28745CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:37:00 (UTC+8)
28744CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:35:25 (UTC+8)
28743CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:33:51 (UTC+8)
28742CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:32:16 (UTC+8)
28741CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:30:42 (UTC+8)
28740CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19138MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:29:07 (UTC+8)
28739CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19038MB | CUDA1 PID:[1529811] 11352MB | CUDA1 PID:[2461994] 6604MB)260620-18:27:33 (UTC+8)
28738CUDA0: 42GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 19038MB | CUDA1 PID:[1529811] 10462MB | CUDA1 PID:[2461994] 6604MB)260620-18:25:58 (UTC+8)
28737CUDA0: 42GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 17858MB | CUDA1 PID:[1529811] 9650MB | CUDA1 PID:[2461994] 6604MB)260620-18:24:24 (UTC+8)
28736CUDA0: 42GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 10932MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2461994] 6604MB)260620-18:22:49 (UTC+8)
28735CUDA0: 42GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 24580MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:21:15 (UTC+8)
28734CUDA0: 42GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 13774MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:19:40 (UTC+8)
28733CUDA0: 42GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30918MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 28096MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:18:06 (UTC+8)
28732CUDA0: 39GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 28658MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 25938MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:16:31 (UTC+8)
28731CUDA0: 34GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 23238MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 23256MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:14:57 (UTC+8)
28730CUDA0: 34GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 23238MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 21396MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:13:22 (UTC+8)
28729CUDA0: 34GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 23238MB | CUDA0 PID:[1529776] 9912MB | CUDA1 PID:[2426109] 16416MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2461994] 6604MB)260620-18:11:48 (UTC+8)
28728CUDA0: 40GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2456130] 30556MB | CUDA0 PID:[1529776] 8970MB | CUDA1 PID:[2426109] 20976MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:10:13 (UTC+8)
28727CUDA0: 32GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2426109] 19698MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:08:39 (UTC+8)
28726CUDA0: 32GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2426109] 19114MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:07:04 (UTC+8)
28725CUDA0: 37GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13014MB | CUDA1 PID:[2426109] 18238MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:05:30 (UTC+8)
28724CUDA0: 37GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13014MB | CUDA1 PID:[2426109] 24716MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:03:55 (UTC+8)
28723CUDA0: 37GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13014MB | CUDA1 PID:[2426109] 21556MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:02:21 (UTC+8)
28722CUDA0: 37GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13014MB | CUDA1 PID:[2426109] 19678MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-18:00:47 (UTC+8)
28721CUDA0: 37GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13014MB | CUDA1 PID:[2426109] 14834MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-17:59:12 (UTC+8)
28720CUDA0: 37GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13012MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-17:57:38 (UTC+8)
28719CUDA0: 37GB / 48GB 93% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13012MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-17:56:03 (UTC+8)
28718CUDA0: 37GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13012MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 11422MB | CUDA1 PID:[2177002] 6604MB)260620-17:54:29 (UTC+8)
28717CUDA0: 37GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13012MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10532MB | CUDA1 PID:[2177002] 6604MB)260620-17:52:54 (UTC+8)
28716CUDA0: 37GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 13012MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10532MB | CUDA1 PID:[2177002] 6604MB)260620-17:51:19 (UTC+8)
28715CUDA0: 36GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 12064MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10532MB | CUDA1 PID:[2177002] 6604MB)260620-17:49:45 (UTC+8)
28714CUDA0: 36GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 12064MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 9668MB | CUDA1 PID:[2177002] 6604MB)260620-17:48:10 (UTC+8)
28713CUDA0: 36GB / 48GB 97% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 12064MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 9668MB | CUDA1 PID:[2177002] 6604MB)260620-17:46:36 (UTC+8)
28712CUDA0: 35GB / 48GB 99% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 11210MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 9668MB | CUDA1 PID:[2177002] 6604MB)260620-17:45:01 (UTC+8)
28711CUDA0: 34GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 10400MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 9668MB | CUDA1 PID:[2177002] 6604MB)260620-17:43:27 (UTC+8)
28710CUDA0: 34GB / 48GB 99% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 10400MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 9668MB | CUDA1 PID:[2177002] 6604MB)260620-17:41:52 (UTC+8)
28709CUDA0: 34GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 10400MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 9668MB | CUDA1 PID:[2177002] 6604MB)260620-17:40:18 (UTC+8)
28708CUDA0: 34GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 22956MB | CUDA0 PID:[1529776] 10400MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2177002] 6604MB)260620-17:38:43 (UTC+8)
28707CUDA0: 41GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 29636MB | CUDA0 PID:[1529776] 10400MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:37:09 (UTC+8)
28706CUDA0: 38GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 27416MB | CUDA0 PID:[1529776] 9608MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:35:34 (UTC+8)
28705CUDA0: 38GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 27416MB | CUDA0 PID:[1529776] 9608MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:34:00 (UTC+8)
28704CUDA0: 39GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 27416MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:32:25 (UTC+8)
28703CUDA0: 39GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 27416MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:30:51 (UTC+8)
28702CUDA0: 36GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 24276MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:29:16 (UTC+8)
28701CUDA0: 36GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 24276MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:27:42 (UTC+8)
28700CUDA0: 36GB / 48GB 94% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 24276MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 19998MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:26:07 (UTC+8)
28699CUDA0: 32GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 20136MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 12964MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:24:33 (UTC+8)
28698CUDA0: 38GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 26156MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 30658MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:22:58 (UTC+8)
28697CUDA0: 32GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 20416MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 24878MB | CUDA1 PID:[1529811] 10538MB | CUDA1 PID:[2177002] 6604MB)260620-17:21:24 (UTC+8)
28696CUDA0: 26GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 14636MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 24878MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:19:49 (UTC+8)
28695CUDA0: 40GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 28476MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 22338MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:18:15 (UTC+8)
28694CUDA0: 37GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 25316MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 22338MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:16:40 (UTC+8)
28693CUDA0: 37GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 25316MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 22338MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:15:06 (UTC+8)
28692CUDA0: 37GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 25316MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 22338MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:13:31 (UTC+8)
28691CUDA0: 46GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2287979] 34736MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 22338MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:11:57 (UTC+8)
28690CUDA0: 12GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 26918MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:10:22 (UTC+8)
28689CUDA0: 46GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 26138MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:08:48 (UTC+8)
28688CUDA0: 46GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 26138MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:07:13 (UTC+8)
28687CUDA0: 46GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[2231489] 26138MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:05:39 (UTC+8)
28686CUDA0: 45GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 9750MB | CUDA1 PID:[2231489] 26138MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:04:05 (UTC+8)
28685CUDA0: 45GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 9750MB | CUDA1 PID:[2231489] 15716MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:02:30 (UTC+8)
28684CUDA0: 45GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 9750MB | CUDA1 PID:[2231489] 32118MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-17:00:56 (UTC+8)
28683CUDA0: 45GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 9750MB | CUDA1 PID:[2231489] 32118MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-16:59:21 (UTC+8)
28682CUDA0: 45GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 8906MB | CUDA1 PID:[2231489] 32116MB | CUDA1 PID:[1529811] 9686MB | CUDA1 PID:[2177002] 6604MB)260620-16:57:47 (UTC+8)
28681CUDA0: 46GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2231489] 32116MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2177002] 6604MB)260620-16:56:12 (UTC+8)
28680CUDA0: 46GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2231489] 19216MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2177002] 6604MB)260620-16:54:38 (UTC+8)
28679CUDA0: 46GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[2177002] 6604MB)260620-16:53:03 (UTC+8)
28678CUDA0: 46GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:51:29 (UTC+8)
28677CUDA0: 46GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:49:54 (UTC+8)
28676CUDA0: 46GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:48:20 (UTC+8)
28675CUDA0: 46GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:46:45 (UTC+8)
28674CUDA0: 45GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34918MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:45:11 (UTC+8)
28673CUDA0: 44GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34076MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:43:36 (UTC+8)
28672CUDA0: 39GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 28676MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:42:02 (UTC+8)
28671CUDA0: 33GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 22716MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:40:27 (UTC+8)
28670CUDA0: 24GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 12614MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:38:53 (UTC+8)
28669CUDA0: 45GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 34098MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[2177002] 6604MB)260620-16:37:18 (UTC+8)
28668CUDA0: 40GB / 48GB 100% || CUDA1: 26GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 29938MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB)260620-16:35:44 (UTC+8)
28667CUDA0: 34GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 22856MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[1929018] 6604MB)260620-16:34:09 (UTC+8)
28666CUDA0: 26GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 14834MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[1929018] 6604MB)260620-16:32:35 (UTC+8)
28665CUDA0: 46GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 35318MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[1929018] 6604MB)260620-16:31:00 (UTC+8)
28664CUDA0: 40GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 29258MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[1929018] 6604MB)260620-16:29:26 (UTC+8)
28663CUDA0: 33GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 22116MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10668MB | CUDA1 PID:[1929018] 6604MB)260620-16:27:51 (UTC+8)
28662CUDA0: 27GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 15914MB | CUDA0 PID:[1529776] 9712MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10664MB | CUDA1 PID:[1929018] 6604MB)260620-16:26:17 (UTC+8)
28661CUDA0: 45GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 35416MB | CUDA0 PID:[1529776] 8800MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10664MB | CUDA1 PID:[1929018] 6604MB)260620-16:24:42 (UTC+8)
28660CUDA0: 37GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 28698MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 10664MB | CUDA1 PID:[1929018] 6604MB)260620-16:23:08 (UTC+8)
28659CUDA0: 32GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 22958MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:21:33 (UTC+8)
28658CUDA0: 34GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 21336MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:19:59 (UTC+8)
28657CUDA0: 30GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2121488] 15596MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:18:24 (UTC+8)
28656CUDA0: 43GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 16236MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:16:50 (UTC+8)
28655CUDA0: 43GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 28338MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:15:15 (UTC+8)
28654CUDA0: 43GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 23076MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:13:41 (UTC+8)
28653CUDA0: 43GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 20574MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-16:12:06 (UTC+8)
28652CUDA0: 43GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 12218MB | CUDA1 PID:[2022253] 20738MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:10:32 (UTC+8)
28651CUDA0: 43GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 12216MB | CUDA1 PID:[2022253] 15394MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:08:57 (UTC+8)
28650CUDA0: 43GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 11310MB | CUDA1 PID:[2022253] 25636MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:07:23 (UTC+8)
28649CUDA0: 43GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 11310MB | CUDA1 PID:[2022253] 15856MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:05:48 (UTC+8)
28648CUDA0: 43GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 11310MB | CUDA1 PID:[2022253] 12336MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:04:14 (UTC+8)
28647CUDA0: 43GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 11310MB | CUDA1 PID:[2022253] 29538MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:02:39 (UTC+8)
28646CUDA0: 43GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 11310MB | CUDA1 PID:[2022253] 25496MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-16:01:05 (UTC+8)
28645CUDA0: 43GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 11310MB | CUDA1 PID:[2022253] 23756MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-15:59:30 (UTC+8)
28644CUDA0: 41GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 9622MB | CUDA1 PID:[2022253] 20116MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-15:57:56 (UTC+8)
28643CUDA0: 41GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 9622MB | CUDA1 PID:[2022253] 21596MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-15:56:22 (UTC+8)
28642CUDA0: 41GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 9622MB | CUDA1 PID:[2022253] 22098MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-15:54:47 (UTC+8)
28641CUDA0: 41GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 9622MB | CUDA1 PID:[2022253] 22416MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-15:53:13 (UTC+8)
28640CUDA0: 40GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 8794MB | CUDA1 PID:[2022253] 22276MB | CUDA1 PID:[1529811] 11636MB | CUDA1 PID:[1929018] 6604MB)260620-15:51:38 (UTC+8)
28639CUDA0: 39GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[2022253] 21016MB | CUDA1 PID:[1529811] 10686MB | CUDA1 PID:[1929018] 6604MB)260620-15:50:04 (UTC+8)
28638CUDA0: 42GB / 48GB 98% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 30476MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[2022253] 18376MB | CUDA1 PID:[1529811] 10686MB | CUDA1 PID:[1929018] 6604MB)260620-15:48:29 (UTC+8)
28637CUDA0: 35GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 23396MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[2022253] 15714MB | CUDA1 PID:[1529811] 9748MB | CUDA1 PID:[1929018] 6604MB)260620-15:46:55 (UTC+8)
28636CUDA0: 30GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 18034MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[2022253] 13614MB | CUDA1 PID:[1529811] 9748MB | CUDA1 PID:[1929018] 6604MB)260620-15:45:20 (UTC+8)
28635CUDA0: 47GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 35698MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[1875763] 25036MB | CUDA1 PID:[1529811] 9748MB | CUDA1 PID:[1929018] 6604MB)260620-15:43:46 (UTC+8)
28634CUDA0: 46GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 35058MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[1875763] 25036MB | CUDA1 PID:[1529811] 9748MB | CUDA1 PID:[1929018] 6604MB)260620-15:42:11 (UTC+8)
28633CUDA0: 46GB / 48GB 99% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 35056MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[1875763] 25036MB | CUDA1 PID:[1529811] 9748MB | CUDA1 PID:[1929018] 6604MB)260620-15:40:37 (UTC+8)
28632CUDA0: 46GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 35056MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[1875763] 25036MB | CUDA1 PID:[1529811] 9748MB | CUDA1 PID:[1929018] 6604MB)260620-15:39:02 (UTC+8)
28631CUDA0: 33GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 21376MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[1875763] 25036MB | CUDA1 PID:[1529811] 9746MB | CUDA1 PID:[1929018] 6604MB)260620-15:37:28 (UTC+8)
28630CUDA0: 32GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 20156MB | CUDA0 PID:[1529776] 10762MB | CUDA1 PID:[1875763] 18736MB | CUDA1 PID:[1529811] 9746MB | CUDA1 PID:[1929018] 6604MB)260620-15:35:53 (UTC+8)
28629CUDA0: 45GB / 48GB 100% || CUDA1: 26GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 33516MB | CUDA0 PID:[1529776] 10760MB | CUDA1 PID:[1875763] 10702MB | CUDA1 PID:[1529811] 9746MB | CUDA1 PID:[1929018] 6604MB)260620-15:34:19 (UTC+8)
28628CUDA0: 38GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 25996MB | CUDA0 PID:[1529776] 10760MB | CUDA1 PID:[1875763] 26376MB | CUDA1 PID:[1529811] 9746MB | CUDA1 PID:[1929018] 6604MB)260620-15:32:44 (UTC+8)
28627CUDA0: 30GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 19416MB | CUDA0 PID:[1529776] 9800MB | CUDA1 PID:[1875763] 18096MB | CUDA1 PID:[1529811] 9746MB | CUDA1 PID:[1929018] 6604MB)260620-15:31:10 (UTC+8)
28626CUDA0: 31GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 19834MB | CUDA0 PID:[1529776] 9800MB | CUDA1 PID:[1875763] 30258MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-15:29:35 (UTC+8)
28625CUDA0: 25GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 13154MB | CUDA0 PID:[1529776] 10630MB | CUDA1 PID:[1875763] 26436MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-15:28:01 (UTC+8)
28624CUDA0: 43GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 31776MB | CUDA0 PID:[1529776] 10630MB | CUDA1 PID:[1875763] 16676MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-15:26:26 (UTC+8)
28623CUDA0: 36GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 25254MB | CUDA0 PID:[1529776] 9722MB | CUDA1 PID:[1875763] 13182MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1929018] 6604MB)260620-15:24:52 (UTC+8)
28622CUDA0: 27GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 15836MB | CUDA0 PID:[1529776] 9722MB | CUDA1 PID:[1875763] 27076MB | CUDA1 PID:[1529811] 12516MB | CUDA1 PID:[1929018] 6604MB)260620-15:23:17 (UTC+8)
28621CUDA0: 20GB / 48GB 91% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1947694] 9834MB | CUDA0 PID:[1529776] 8868MB | CUDA1 PID:[1875763] 17554MB | CUDA1 PID:[1529811] 11550MB | CUDA1 PID:[1929018] 6604MB)260620-15:21:43 (UTC+8)
28620CUDA0: 25GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 15456MB | CUDA0 PID:[1529776] 8868MB | CUDA1 PID:[1875763] 28216MB | CUDA1 PID:[1529811] 11550MB | CUDA1 PID:[1929018] 6604MB)260620-15:20:08 (UTC+8)
28619CUDA0: 25GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 15456MB | CUDA0 PID:[1529776] 8868MB | CUDA1 PID:[1875763] 15978MB | CUDA1 PID:[1529811] 11550MB | CUDA1 PID:[1929018] 6604MB)260620-15:18:34 (UTC+8)
28618CUDA0: 25GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 15456MB | CUDA0 PID:[1529776] 8868MB | CUDA1 PID:[1875763] 27756MB | CUDA1 PID:[1529811] 10628MB | CUDA1 PID:[1929018] 6604MB)260620-15:16:59 (UTC+8)
28617CUDA0: 25GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 15456MB | CUDA0 PID:[1529776] 8868MB | CUDA1 PID:[1875763] 27054MB | CUDA1 PID:[1529811] 10628MB | CUDA1 PID:[1917005] 6604MB)260620-15:15:25 (UTC+8)
28616CUDA0: 39GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 30016MB | CUDA0 PID:[1529776] 8052MB | CUDA1 PID:[1875763] 18896MB | CUDA1 PID:[1529811] 10628MB | CUDA1 PID:[1917005] 6604MB)260620-15:13:50 (UTC+8)
28615CUDA0: 35GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 22056MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 32898MB | CUDA1 PID:[1529811] 10628MB)260620-15:12:16 (UTC+8)
28614CUDA0: 46GB / 48GB 100% || CUDA1: 35GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 33276MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 25240MB | CUDA1 PID:[1529811] 10628MB)260620-15:10:41 (UTC+8)
28613CUDA0: 37GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 23716MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 17796MB | CUDA1 PID:[1529811] 10628MB)260620-15:09:07 (UTC+8)
28612CUDA0: 47GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 34456MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 36978MB | CUDA1 PID:[1529811] 10628MB)260620-15:07:32 (UTC+8)
28611CUDA0: 40GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 26858MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 34616MB | CUDA1 PID:[1529811] 10628MB)260620-15:05:58 (UTC+8)
28610CUDA0: 30GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 16636MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 24596MB | CUDA1 PID:[1529811] 10628MB)260620-15:04:23 (UTC+8)
28609CUDA0: 46GB / 48GB 100% || CUDA1: 25GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 33056MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 15236MB | CUDA1 PID:[1529811] 10628MB)260620-15:02:49 (UTC+8)
28608CUDA0: 37GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 23656MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 35976MB | CUDA1 PID:[1529811] 9726MB)260620-15:01:14 (UTC+8)
28607CUDA0: 27GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 13302MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1875763] 28194MB | CUDA1 PID:[1529811] 9726MB)260620-14:59:40 (UTC+8)
28606CUDA0: 41GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 27916MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1741986] 37016MB | CUDA1 PID:[1529811] 9726MB)260620-14:58:05 (UTC+8)
28605CUDA0: 32GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 19156MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1741986] 37016MB | CUDA1 PID:[1529811] 9726MB)260620-14:56:31 (UTC+8)
28604CUDA0: 46GB / 48GB 100% || CUDA1: 46GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 32596MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1741986] 37016MB | CUDA1 PID:[1529811] 9726MB)260620-14:54:56 (UTC+8)
28603CUDA0: 39GB / 48GB 100% || CUDA1: 22GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 25676MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1741986] 12520MB | CUDA1 PID:[1529811] 9726MB)260620-14:50:04 (UTC+8)
28602CUDA0: 27GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 14454MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1741986] 31216MB | CUDA1 PID:[1529811] 9726MB)260620-14:48:29 (UTC+8)
28601CUDA0: 43GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 30298MB | CUDA0 PID:[1529776] 12270MB | CUDA1 PID:[1741986] 23918MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1830213] 6604MB)260620-14:46:55 (UTC+8)
28600CUDA0: 33GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 21116MB | CUDA0 PID:[1529776] 10464MB | CUDA1 PID:[1741986] 15816MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[1830213] 6604MB)260620-14:45:20 (UTC+8)
28599CUDA0: 47GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 37038MB | CUDA0 PID:[1529776] 9640MB | CUDA1 PID:[1741986] 12322MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1830213] 6604MB)260620-14:43:46 (UTC+8)
28598CUDA0: 42GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1823704] 31158MB | CUDA0 PID:[1529776] 9638MB | CUDA1 PID:[1741986] 18574MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:42:11 (UTC+8)
28597CUDA0: 29GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 18158MB | CUDA0 PID:[1529776] 9638MB | CUDA1 PID:[1741986] 25616MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:40:37 (UTC+8)
28596CUDA0: 29GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 18158MB | CUDA0 PID:[1529776] 9638MB | CUDA1 PID:[1741986] 17814MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:39:02 (UTC+8)
28595CUDA0: 27GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 18158MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[1741986] 29918MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:37:28 (UTC+8)
28594CUDA0: 29GB / 48GB 99% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 18158MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 19716MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:35:53 (UTC+8)
28593CUDA0: 29GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 18158MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 12822MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:34:19 (UTC+8)
28592CUDA0: 37GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 26098MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 24258MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:32:44 (UTC+8)
28591CUDA0: 28GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 17274MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 17454MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:31:10 (UTC+8)
28590CUDA0: 45GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 34676MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 26696MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:29:35 (UTC+8)
28589CUDA0: 44GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 33378MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 29276MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:28:01 (UTC+8)
28588CUDA0: 37GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 25996MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 21836MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:26:26 (UTC+8)
28587CUDA0: 32GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 20716MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 18394MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:24:52 (UTC+8)
28586CUDA0: 25GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 13416MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 29896MB | CUDA1 PID:[1529811] 11454MB | CUDA1 PID:[1501755] 6604MB)260620-14:23:18 (UTC+8)
28585CUDA0: 44GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 33418MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 21116MB | CUDA1 PID:[1529811] 11450MB | CUDA1 PID:[1501755] 6604MB)260620-14:21:43 (UTC+8)
28584CUDA0: 24GB / 48GB 99% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 13226MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 27918MB | CUDA1 PID:[1529811] 11450MB | CUDA1 PID:[1501755] 6604MB)260620-14:16:50 (UTC+8)
28583CUDA0: 43GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 32616MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 19096MB | CUDA1 PID:[1529811] 11450MB | CUDA1 PID:[1501755] 6604MB)260620-14:15:16 (UTC+8)
28582CUDA0: 37GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 25916MB | CUDA0 PID:[1529776] 9984MB | CUDA1 PID:[1741986] 27676MB | CUDA1 PID:[1529811] 11450MB | CUDA1 PID:[1501755] 6604MB)260620-14:13:41 (UTC+8)
28581CUDA0: 29GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 18454MB | CUDA0 PID:[1529776] 9982MB | CUDA1 PID:[1591666] 13536MB | CUDA1 PID:[1529811] 11450MB | CUDA1 PID:[1501755] 6604MB)260620-14:12:07 (UTC+8)
28580CUDA0: 47GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 36416MB | CUDA0 PID:[1529776] 9982MB | CUDA1 PID:[1591666] 13536MB | CUDA1 PID:[1529811] 11450MB | CUDA1 PID:[1501755] 6604MB)260620-14:10:32 (UTC+8)
28579CUDA0: 39GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 27956MB | CUDA0 PID:[1529776] 9982MB | CUDA1 PID:[1591666] 13536MB | CUDA1 PID:[1529811] 10466MB | CUDA1 PID:[1501755] 6604MB)260620-14:08:58 (UTC+8)
28578CUDA0: 32GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 21096MB | CUDA0 PID:[1529776] 9982MB | CUDA1 PID:[1591666] 13536MB | CUDA1 PID:[1529811] 10466MB | CUDA1 PID:[1501755] 6604MB)260620-14:07:23 (UTC+8)
28577CUDA0: 23GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 13098MB | CUDA0 PID:[1529776] 9030MB | CUDA1 PID:[1591666] 13536MB | CUDA1 PID:[1529811] 10466MB | CUDA1 PID:[1501755] 6604MB)260620-14:05:49 (UTC+8)
28576CUDA0: 43GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 32956MB | CUDA0 PID:[1529776] 9030MB | CUDA1 PID:[1591666] 13536MB | CUDA1 PID:[1529811] 10466MB | CUDA1 PID:[1501755] 6604MB)260620-14:04:14 (UTC+8)
28575CUDA0: 37GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 26856MB | CUDA0 PID:[1529776] 9030MB | CUDA1 PID:[1591666] 26516MB | CUDA1 PID:[1529811] 10466MB | CUDA1 PID:[1501755] 6604MB)260620-14:02:40 (UTC+8)
28574CUDA0: 30GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1703369] 19974MB | CUDA0 PID:[1529776] 9030MB | CUDA1 PID:[1591666] 18734MB | CUDA1 PID:[1529811] 10466MB | CUDA1 PID:[1501755] 6604MB)260620-14:01:05 (UTC+8)
28573CUDA0: 44GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 32256MB | CUDA0 PID:[1529776] 11520MB | CUDA1 PID:[1591666] 28976MB | CUDA1 PID:[1529811] 9648MB | CUDA1 PID:[1501755] 6604MB)260620-13:59:31 (UTC+8)
28572CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 32256MB | CUDA0 PID:[1529776] 11520MB | CUDA1 PID:[1591666] 23856MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:57:56 (UTC+8)
28571CUDA0: 44GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 32256MB | CUDA0 PID:[1529776] 11520MB | CUDA1 PID:[1591666] 18634MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:56:22 (UTC+8)
28570CUDA0: 44GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 32256MB | CUDA0 PID:[1529776] 11520MB | CUDA1 PID:[1591666] 31856MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:54:47 (UTC+8)
28569CUDA0: 44GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 32256MB | CUDA0 PID:[1529776] 11520MB | CUDA1 PID:[1591666] 27976MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:53:13 (UTC+8)
28568CUDA0: 34GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 21956MB | CUDA0 PID:[1529776] 11520MB | CUDA1 PID:[1591666] 19714MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:51:38 (UTC+8)
28567CUDA0: 46GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 33918MB | CUDA0 PID:[1529776] 11518MB | CUDA1 PID:[1591666] 30116MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:50:04 (UTC+8)
28566CUDA0: 37GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 24996MB | CUDA0 PID:[1529776] 11518MB | CUDA1 PID:[1591666] 24096MB | CUDA1 PID:[1529811] 9808MB | CUDA1 PID:[1501755] 6604MB)260620-13:48:29 (UTC+8)
28565CUDA0: 43GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 29376MB | CUDA0 PID:[1529776] 11518MB | CUDA1 PID:[1591666] 16436MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:46:55 (UTC+8)
28564CUDA0: 42GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 30016MB | CUDA0 PID:[1529776] 11518MB | CUDA1 PID:[1591666] 31618MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:45:20 (UTC+8)
28563CUDA0: 32GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 19756MB | CUDA0 PID:[1529776] 11518MB | CUDA1 PID:[1591666] 26636MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:43:46 (UTC+8)
28562CUDA0: 44GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 31856MB | CUDA0 PID:[1529776] 11518MB | CUDA1 PID:[1591666] 18194MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:42:11 (UTC+8)
28561CUDA0: 37GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 25214MB | CUDA0 PID:[1529776] 10560MB | CUDA1 PID:[1591666] 32056MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:40:37 (UTC+8)
28560CUDA0: 28GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 16174MB | CUDA0 PID:[1529776] 10560MB | CUDA1 PID:[1591666] 24840MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:39:02 (UTC+8)
28559CUDA0: 47GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 35876MB | CUDA0 PID:[1529776] 10560MB | CUDA1 PID:[1591666] 15996MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:37:28 (UTC+8)
28558CUDA0: 45GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 33316MB | CUDA0 PID:[1529776] 10560MB | CUDA1 PID:[1591666] 30276MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:35:53 (UTC+8)
28557CUDA0: 44GB / 48GB 100% || CUDA1: 39GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 32258MB | CUDA0 PID:[1529776] 10560MB | CUDA1 PID:[1591666] 23478MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:34:19 (UTC+8)
28556CUDA0: 38GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 26796MB | CUDA0 PID:[1529776] 10560MB | CUDA1 PID:[1591666] 15084MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:32:44 (UTC+8)
28555CUDA0: 29GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 18596MB | CUDA0 PID:[1529776] 9662MB | CUDA1 PID:[1591666] 29876MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:31:10 (UTC+8)
28554CUDA0: 45GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 35718MB | CUDA0 PID:[1529776] 8838MB | CUDA1 PID:[1591666] 20276MB | CUDA1 PID:[1529811] 9804MB | CUDA1 PID:[1501755] 6604MB)260620-13:29:35 (UTC+8)
28553CUDA0: 41GB / 48GB 100% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 31658MB | CUDA0 PID:[1529776] 8838MB | CUDA1 PID:[1529811] 11474MB | CUDA1 PID:[1591666] 11360MB | CUDA1 PID:[1501755] 6604MB)260620-13:28:01 (UTC+8)
28552CUDA0: 39GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 28918MB | CUDA0 PID:[1529776] 8836MB | CUDA1 PID:[1591666] 25656MB | CUDA1 PID:[1529811] 11474MB | CUDA1 PID:[1501755] 6604MB)260620-13:26:26 (UTC+8)
28551CUDA0: 31GB / 48GB 99% || CUDA1: 29GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 21576MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[1591666] 12950MB | CUDA1 PID:[1529811] 10544MB | CUDA1 PID:[1501755] 6604MB)260620-13:24:52 (UTC+8)
28550CUDA0: 24GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 15156MB | CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[1050808] 24716MB | CUDA1 PID:[1529811] 10544MB | CUDA1 PID:[1501755] 6604MB)260620-13:23:17 (UTC+8)
28549CUDA0: 45GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1576938] 35818MB | CUDA0 PID:[1529776] 8048MB | CUDA1 PID:[1050808] 24716MB | CUDA1 PID:[1529811] 9636MB | CUDA1 PID:[1501755] 6604MB)260620-13:21:43 (UTC+8)
28548CUDA0: 35GB / 48GB 98% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23818MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[1050808] 24716MB | CUDA1 PID:[1529811] 9636MB | CUDA1 PID:[1501755] 6604MB)260620-13:20:09 (UTC+8)
28547CUDA0: 35GB / 48GB 99% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23818MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[1050808] 24716MB | CUDA1 PID:[1529811] 9636MB | CUDA1 PID:[1501755] 6604MB)260620-13:18:34 (UTC+8)
28546CUDA0: 35GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23818MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[1050808] 24716MB | CUDA1 PID:[1529811] 9632MB | CUDA1 PID:[1501755] 6604MB)260620-13:17:00 (UTC+8)
28545CUDA0: 35GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23818MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[1050808] 31376MB | CUDA1 PID:[1529811] 9632MB | CUDA1 PID:[1501755] 6604MB)260620-13:15:25 (UTC+8)
28544CUDA0: 35GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23818MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[1050808] 22714MB | CUDA1 PID:[1529811] 9632MB | CUDA1 PID:[1501755] 6604MB)260620-13:13:50 (UTC+8)
28543CUDA0: 41GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 29638MB | CUDA0 PID:[1529776] 10648MB | CUDA1 PID:[1050808] 21636MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1529811] 9632MB | CUDA1 PID:[1501755] 6604MB)260620-13:12:16 (UTC+8)
28542CUDA0: 37GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 15414MB | CUDA0 PID:[1529776] 10648MB | CUDA0 PID:[1003926] 9918MB | CUDA1 PID:[1050808] 13364MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1529811] 8756MB | CUDA1 PID:[1501755] 6604MB)260620-13:10:41 (UTC+8)
28541CUDA0: 46GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 24896MB | CUDA0 PID:[1529776] 10648MB | CUDA0 PID:[1003926] 9918MB | CUDA1 PID:[1050808] 17274MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-13:09:07 (UTC+8)
28540CUDA0: 39GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 17916MB | CUDA0 PID:[1529776] 10648MB | CUDA0 PID:[1003926] 9918MB | CUDA1 PID:[1050808] 18654MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-13:07:32 (UTC+8)
28539CUDA0: 46GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 25658MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 13536MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-13:05:58 (UTC+8)
28538CUDA0: 42GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 21294MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 14364MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-13:04:23 (UTC+8)
28537CUDA0: 47GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 26754MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 16054MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-13:02:49 (UTC+8)
28536CUDA0: 39GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 18556MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 18416MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-13:01:14 (UTC+8)
28535CUDA0: 47GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 26876MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1050808] 11304MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-12:59:40 (UTC+8)
28534CUDA0: 41GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 20936MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 14494MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB | CUDA1 PID:[1501755] 6604MB)260620-12:58:05 (UTC+8)
28533CUDA0: 47GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 26956MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 13618MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB)260620-12:56:31 (UTC+8)
28532CUDA0: 44GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23438MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 19656MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB)260620-12:54:56 (UTC+8)
28531CUDA0: 43GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 22716MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 25256MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB)260620-12:53:22 (UTC+8)
28530CUDA0: 37GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 16414MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 19816MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB)260620-12:51:47 (UTC+8)
28529CUDA0: 44GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23858MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 24756MB | CUDA1 PID:[1529811] 13168MB | CUDA1 PID:[1003753] 9938MB)260620-12:50:12 (UTC+8)
28528CUDA0: 39GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 18456MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 17396MB | CUDA1 PID:[1529811] 13166MB | CUDA1 PID:[1003753] 9938MB)260620-12:48:37 (UTC+8)
28527CUDA0: 34GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 13200MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 20516MB | CUDA1 PID:[1529811] 13166MB | CUDA1 PID:[1003753] 9938MB)260620-12:47:02 (UTC+8)
28526CUDA0: 45GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 24578MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 25178MB | CUDA1 PID:[1529811] 13166MB | CUDA1 PID:[1003753] 9938MB)260620-12:45:28 (UTC+8)
28525CUDA0: 38GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 17894MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 16118MB | CUDA1 PID:[1529811] 13166MB | CUDA1 PID:[1003753] 9918MB)260620-12:43:52 (UTC+8)
28524CUDA0: 40GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 19674MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 21354MB | CUDA1 PID:[1529811] 12262MB | CUDA1 PID:[1003753] 9918MB)260620-12:42:17 (UTC+8)
28523CUDA0: 47GB / 48GB 100% || CUDA1: 47GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 27058MB | CUDA0 PID:[1003926] 9918MB | CUDA0 PID:[1529776] 9710MB | CUDA1 PID:[1050808] 25596MB | CUDA1 PID:[1529811] 12262MB | CUDA1 PID:[1003753] 9918MB)260620-12:40:42 (UTC+8)
28522CUDA0: 40GB / 48GB 100% || CUDA1: 40GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 19196MB | CUDA0 PID:[1529776] 10536MB | CUDA0 PID:[1003926] 9918MB | CUDA1 PID:[1050808] 18314MB | CUDA1 PID:[1529811] 12262MB | CUDA1 PID:[1003753] 9918MB)260620-12:39:08 (UTC+8)
28521CUDA0: 47GB / 48GB 100% || CUDA1: 46GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 25916MB | CUDA0 PID:[1529776] 10536MB | CUDA0 PID:[1003926] 9918MB | CUDA1 PID:[1050808] 24936MB | CUDA1 PID:[1529811] 12262MB | CUDA1 PID:[1003753] 9918MB)260620-12:37:32 (UTC+8)
28520CUDA0: 37GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 16156MB | CUDA0 PID:[1529776] 10536MB | CUDA0 PID:[1003926] 9878MB | CUDA1 PID:[1050808] 14796MB | CUDA1 PID:[1529811] 12262MB | CUDA1 PID:[1003753] 9918MB)260620-12:35:57 (UTC+8)
28519CUDA0: 44GB / 48GB 100% || CUDA1: 43GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 23758MB | CUDA0 PID:[1003926] 9878MB | CUDA0 PID:[1529776] 9664MB | CUDA1 PID:[1050808] 22556MB | CUDA1 PID:[1529811] 11372MB | CUDA1 PID:[1003753] 9918MB)260620-12:34:22 (UTC+8)
28518CUDA0: 33GB / 48GB 100% || CUDA1: 34GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 13788MB | CUDA0 PID:[1003926] 9878MB | CUDA0 PID:[1529776] 8818MB | CUDA1 PID:[1050808] 13802MB | CUDA1 PID:[1529811] 11372MB | CUDA1 PID:[1003753] 9858MB)260620-12:32:45 (UTC+8)
28517CUDA0: 47GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 25516MB | CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[1003926] 9878MB | CUDA1 PID:[1050808] 21476MB | CUDA1 PID:[1529811] 11372MB | CUDA1 PID:[1003753] 9858MB)260620-12:31:11 (UTC+8)
28516CUDA0: 36GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 14694MB | CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[1003926] 9878MB | CUDA1 PID:[1050808] 12324MB | CUDA1 PID:[1529811] 11372MB | CUDA1 PID:[1003753] 9858MB)260620-12:29:36 (UTC+8)
28515CUDA0: 43GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1050679] 22214MB | CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[1003926] 9878MB | CUDA1 PID:[1050808] 21734MB | CUDA1 PID:[1529811] 11372MB | CUDA1 PID:[1003753] 9858MB)260620-12:28:02 (UTC+8)
28514CUDA0: 22GB / 48GB 100% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[1003926] 9878MB | CUDA1 PID:[1529811] 10506MB | CUDA1 PID:[1003753] 9838MB)260620-12:26:27 (UTC+8)
28513CUDA0: 22GB / 48GB 100% || CUDA1: 20GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[1003926] 9876MB | CUDA1 PID:[1529811] 10506MB | CUDA1 PID:[1003753] 9836MB)260620-12:24:52 (UTC+8)
28512CUDA0: 21GB / 48GB 98% || CUDA1: 17GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[989576] 9000MB | CUDA1 PID:[989447] 9000MB | CUDA1 PID:[1529811] 8846MB)260620-12:23:18 (UTC+8)
28511CUDA0: 12GB / 48GB 99% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA1 PID:[1529811] 8846MB | CUDA1 PID:[964183] 2994MB)260620-12:21:43 (UTC+8)
28510CUDA0: 17GB / 48GB 98% || CUDA1: 19GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA0 PID:[937856] 5108MB | CUDA1 PID:[1529811] 10644MB | CUDA1 PID:[937647] 9000MB)260620-12:20:09 (UTC+8)
28509CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA1 PID:[1529811] 10644MB)260620-12:18:34 (UTC+8)
28508CUDA0: 12GB / 48GB 95% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10626MB | CUDA1 PID:[1529811] 10644MB)260620-12:17:00 (UTC+8)
28507CUDA0: 11GB / 48GB 97% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9668MB | CUDA1 PID:[1529811] 9710MB)260620-12:15:25 (UTC+8)
28506CUDA0: 11GB / 48GB 96% || CUDA1: 10GB / 48GB 65% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9668MB | CUDA1 PID:[1529811] 9710MB)260620-12:13:51 (UTC+8)
28505CUDA0: 10GB / 48GB 94% || CUDA1: 10GB / 48GB 90% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8790MB | CUDA1 PID:[1529811] 9710MB)260620-12:12:16 (UTC+8)
28504CUDA0: 15GB / 48GB 95% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 13092MB | CUDA1 PID:[1529811] 9708MB)260620-12:10:42 (UTC+8)
28503CUDA0: 15GB / 48GB 96% || CUDA1: 10GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 13092MB | CUDA1 PID:[1529811] 9708MB)260620-12:09:08 (UTC+8)
28502CUDA0: 14GB / 48GB 91% || CUDA1: 10GB / 48GB 61% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12182MB | CUDA1 PID:[1529811] 9708MB)260620-12:07:33 (UTC+8)
28501CUDA0: 21GB / 48GB 97% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12182MB | CUDA0 PID:[707286] 8138MB | CUDA1 PID:[1529811] 9708MB)260620-12:05:59 (UTC+8)
28500CUDA0: 22GB / 48GB 97% || CUDA1: 20GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12182MB | CUDA0 PID:[679067] 9000MB | CUDA1 PID:[1529811] 11634MB | CUDA1 PID:[679238] 9000MB)260620-12:04:24 (UTC+8)
28499CUDA0: 22GB / 48GB 98% || CUDA1: 19GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12182MB | CUDA0 PID:[652179] 9082MB | CUDA1 PID:[1529811] 10638MB | CUDA1 PID:[652297] 9104MB)260620-12:02:50 (UTC+8)
28498CUDA0: 13GB / 48GB 96% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11294MB | CUDA1 PID:[1529811] 10638MB)260620-12:01:15 (UTC+8)
28497CUDA0: 13GB / 48GB 99% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11294MB | CUDA1 PID:[1529811] 10636MB)260620-11:59:41 (UTC+8)
28496CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10426MB | CUDA1 PID:[1529811] 9730MB)260620-11:58:06 (UTC+8)
28495CUDA0: 12GB / 48GB 98% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10426MB | CUDA1 PID:[1529811] 9730MB)260620-11:56:32 (UTC+8)
28494CUDA0: 11GB / 48GB 96% || CUDA1: 10GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9612MB | CUDA1 PID:[1529811] 9730MB)260620-11:54:57 (UTC+8)
28493CUDA0: 14GB / 48GB 98% || CUDA1: 9GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12402MB | CUDA1 PID:[1529811] 8938MB)260620-11:53:23 (UTC+8)
28492CUDA0: 14GB / 48GB 99% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12402MB | CUDA1 PID:[1529811] 8938MB)260620-11:51:48 (UTC+8)
28491CUDA0: 14GB / 48GB 99% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12402MB | CUDA1 PID:[1529811] 8938MB)260620-11:50:14 (UTC+8)
28490CUDA0: 14GB / 48GB 98% || CUDA1: 8GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12402MB | CUDA1 PID:[1529811] 8050MB)260620-11:48:39 (UTC+8)
28489CUDA0: 14GB / 48GB 71% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12402MB | CUDA1 PID:[1529811] 10668MB)260620-11:47:04 (UTC+8)
28488CUDA0: 13GB / 48GB 99% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11442MB | CUDA1 PID:[1529811] 10668MB)260620-11:45:30 (UTC+8)
28487CUDA0: 13GB / 48GB 99% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11442MB | CUDA1 PID:[1529811] 10668MB)260620-11:43:55 (UTC+8)
28486CUDA0: 13GB / 48GB 99% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11442MB | CUDA1 PID:[1529811] 10668MB)260620-11:42:21 (UTC+8)
28485CUDA0: 12GB / 48GB 97% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10512MB | CUDA1 PID:[1529811] 10668MB)260620-11:40:46 (UTC+8)
28484CUDA0: 11GB / 48GB 99% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9658MB | CUDA1 PID:[1529811] 10668MB)260620-11:39:12 (UTC+8)
28483CUDA0: 14GB / 48GB 100% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12266MB | CUDA1 PID:[1529811] 10668MB)260620-11:37:35 (UTC+8)
28482CUDA0: 14GB / 48GB 98% || CUDA1: 10GB / 48GB 93% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12266MB | CUDA1 PID:[1529811] 10668MB)260620-11:36:01 (UTC+8)
28481CUDA0: 14GB / 48GB 97% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12266MB | CUDA1 PID:[1529811] 9708MB)260620-11:34:25 (UTC+8)
28480CUDA0: 14GB / 48GB 98% || CUDA1: 8GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12266MB | CUDA1 PID:[1529811] 8054MB)260620-11:32:51 (UTC+8)
28479CUDA0: 14GB / 48GB 98% || CUDA1: 11GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12266MB | CUDA1 PID:[1529811] 11400MB)260620-11:31:17 (UTC+8)
28478CUDA0: 22GB / 48GB 98% || CUDA1: 11GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11352MB | CUDA0 PID:[97508] 9276MB | CUDA1 PID:[1529811] 11400MB)260620-11:29:42 (UTC+8)
28477CUDA0: 13GB / 48GB 99% || CUDA1: 11GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11352MB | CUDA1 PID:[1529811] 11400MB)260620-11:28:07 (UTC+8)
28476CUDA0: 22GB / 48GB 98% || CUDA1: 11GB / 48GB 83% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11352MB | CUDA1 PID:[1529811] 11400MB)260620-11:26:33 (UTC+8)
28475CUDA0: 12GB / 48GB 94% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10468MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:24:58 (UTC+8)
28474CUDA0: 28GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 16818MB | CUDA0 PID:[1529776] 10468MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:23:23 (UTC+8)
28473CUDA0: 28GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 16818MB | CUDA0 PID:[1529776] 10468MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:21:49 (UTC+8)
28472CUDA0: 32GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 16818MB | CUDA0 PID:[1529776] 9636MB | CUDA0 PID:[4009865] 4450MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:20:14 (UTC+8)
28471CUDA0: 31GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 16818MB | CUDA0 PID:[1529776] 8842MB | CUDA0 PID:[4009865] 4448MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:18:39 (UTC+8)
28470CUDA0: 31GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 16818MB | CUDA0 PID:[1529776] 8842MB | CUDA0 PID:[4009865] 4448MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:17:04 (UTC+8)
28469CUDA0: 34GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 16818MB | CUDA0 PID:[1529776] 11402MB | CUDA0 PID:[4009865] 4446MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:15:30 (UTC+8)
28468CUDA0: 32GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 19340MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:13:55 (UTC+8)
28467CUDA0: 28GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 14856MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 11400MB)260620-11:12:20 (UTC+8)
28466CUDA0: 45GB / 48GB 100% || CUDA1: 42GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 33142MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 9654MB)260620-11:10:46 (UTC+8)
28465CUDA0: 36GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 24196MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 8870MB)260620-11:09:11 (UTC+8)
28464CUDA0: 47GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 34544MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33544MB | CUDA1 PID:[1529811] 8054MB)260620-11:07:36 (UTC+8)
28463CUDA0: 46GB / 48GB 100% || CUDA1: 41GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 33802MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33542MB | CUDA1 PID:[1529811] 8054MB)260620-11:06:01 (UTC+8)
28462CUDA0: 45GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 32680MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 33542MB | CUDA1 PID:[1529811] 8054MB)260620-11:04:26 (UTC+8)
28461CUDA0: 45GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 32680MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 31180MB | CUDA1 PID:[1529811] 10620MB | CUDA1 PID:[3524250] 4342MB)260620-11:02:51 (UTC+8)
28460CUDA0: 47GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 35202MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 31180MB | CUDA1 PID:[1529811] 10620MB | CUDA1 PID:[3524250] 4064MB)260620-11:01:16 (UTC+8)
28459CUDA0: 42GB / 48GB 100% || CUDA1: 44GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 30080MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 31180MB | CUDA1 PID:[1529811] 10620MB | CUDA1 PID:[3524250] 2948MB)260620-10:59:41 (UTC+8)
28458CUDA0: 45GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 33276MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 31180MB | CUDA1 PID:[1529811] 10620MB)260620-10:58:06 (UTC+8)
28457CUDA0: 37GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 24638MB | CUDA0 PID:[1529776] 11402MB | CUDA1 PID:[3272497] 31180MB | CUDA1 PID:[1529811] 10620MB)260620-10:56:31 (UTC+8)
28456CUDA0: 33GB / 48GB 100% || CUDA1: 30GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 21198MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[3272497] 20120MB | CUDA1 PID:[1529811] 10620MB)260620-10:54:56 (UTC+8)
28455CUDA0: 32GB / 48GB 100% || CUDA1: 45GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 20402MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[3272497] 31602MB | CUDA1 PID:[1529811] 10620MB | CUDA1 PID:[3387013] 4310MB)260620-10:53:22 (UTC+8)
28454CUDA0: 37GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 25458MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[3272497] 31602MB | CUDA1 PID:[1529811] 10620MB)260620-10:51:47 (UTC+8)
28453CUDA0: 34GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 22578MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[3272497] 31602MB | CUDA1 PID:[1529811] 10620MB)260620-10:50:12 (UTC+8)
28452CUDA0: 41GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 29902MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[3272497] 31602MB | CUDA1 PID:[1529811] 10618MB)260620-10:48:36 (UTC+8)
28451CUDA0: 41GB / 48GB 100% || CUDA1: 31GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 29716MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[3272497] 22378MB | CUDA1 PID:[1529811] 9740MB)260620-10:47:02 (UTC+8)
28450CUDA0: 37GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[3248271] 25216MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:45:27 (UTC+8)
28449CUDA0: 45GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:43:52 (UTC+8)
28448CUDA0: 45GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 10506MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB | CUDA1 PID:[3142985] 4914MB)260620-10:42:17 (UTC+8)
28447CUDA0: 44GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 9626MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB | CUDA1 PID:[3142985] 4450MB)260620-10:40:41 (UTC+8)
28446CUDA0: 44GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 8798MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:39:06 (UTC+8)
28445CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:37:32 (UTC+8)
28444CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:35:58 (UTC+8)
28443CUDA0: 46GB / 48GB 100% || CUDA1: 41GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB | CUDA1 PID:[3048355] 4404MB)260620-10:34:23 (UTC+8)
28442CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:32:48 (UTC+8)
28441CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:31:12 (UTC+8)
28440CUDA0: 46GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 34044MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:29:37 (UTC+8)
28439CUDA0: 39GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 27000MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:28:01 (UTC+8)
28438CUDA0: 36GB / 48GB 100% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 24258MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:26:26 (UTC+8)
28437CUDA0: 36GB / 48GB 96% || CUDA1: 37GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 23622MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 9740MB)260620-10:24:51 (UTC+8)
28436CUDA0: 34GB / 48GB 100% || CUDA1: 35GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 21858MB | CUDA0 PID:[1529776] 11544MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 8054MB)260620-10:23:17 (UTC+8)
28435CUDA0: 36GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 24380MB | CUDA0 PID:[1529776] 10622MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 11380MB)260620-10:21:42 (UTC+8)
28434CUDA0: 45GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 33382MB | CUDA0 PID:[1529776] 10622MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 11380MB)260620-10:20:07 (UTC+8)
28433CUDA0: 38GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 26242MB | CUDA0 PID:[1529776] 10622MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 11380MB)260620-10:18:32 (UTC+8)
28432CUDA0: 33GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 21622MB | CUDA0 PID:[1529776] 10622MB | CUDA1 PID:[2541113] 27624MB | CUDA1 PID:[1529811] 11380MB)260620-10:16:57 (UTC+8)
28431CUDA0: 44GB / 48GB 100% || CUDA1: 38GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 32182MB | CUDA0 PID:[1529776] 10622MB | CUDA1 PID:[2541113] 27622MB | CUDA1 PID:[1529811] 11380MB)260620-10:15:23 (UTC+8)
28430CUDA0: 41GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 29220MB | CUDA0 PID:[1529776] 10622MB | CUDA1 PID:[2541113] 21682MB | CUDA1 PID:[1529811] 11380MB)260620-10:13:48 (UTC+8)
28429CUDA0: 44GB / 48GB 100% || CUDA1: 32GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 33382MB | CUDA0 PID:[1529776] 9718MB | CUDA1 PID:[2541113] 21682MB | CUDA1 PID:[1529811] 11380MB)260620-10:12:10 (UTC+8)
28428CUDA0: 41GB / 48GB 100% || CUDA1: 28GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 30342MB | CUDA0 PID:[1529776] 9718MB | CUDA1 PID:[2541113] 16942MB | CUDA1 PID:[1529811] 11380MB)260620-10:10:35 (UTC+8)
28427CUDA0: 36GB / 48GB 100% || CUDA1: 36GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 25440MB | CUDA0 PID:[1529776] 9718MB | CUDA1 PID:[2541113] 25598MB | CUDA1 PID:[1529811] 11380MB)260620-10:09:01 (UTC+8)
28426CUDA0: 32GB / 48GB 100% || CUDA1: 33GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[2541439] 21260MB | CUDA0 PID:[1529776] 9718MB | CUDA1 PID:[2541113] 22358MB | CUDA1 PID:[1529811] 11380MB)260620-10:07:26 (UTC+8)
28425CUDA0: 11GB / 48GB 97% || CUDA1: 11GB / 48GB 48% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9718MB | CUDA1 PID:[1529811] 11380MB)260620-10:05:52 (UTC+8)
28424CUDA0: 10GB / 48GB 98% || CUDA1: 10GB / 48GB 95% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8054MB | CUDA1 PID:[1529811] 10516MB)260620-10:04:17 (UTC+8)
28423CUDA0: 13GB / 48GB 98% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11638MB | CUDA1 PID:[1529811] 10516MB)260620-10:02:42 (UTC+8)
28422CUDA0: 13GB / 48GB 97% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11638MB | CUDA1 PID:[1529811] 10516MB)260620-10:01:07 (UTC+8)
28421CUDA0: 13GB / 48GB 99% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11638MB | CUDA1 PID:[1529811] 9656MB)260620-09:59:32 (UTC+8)
28420CUDA0: 13GB / 48GB 98% || CUDA1: 8GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11638MB | CUDA1 PID:[1529811] 8054MB)260620-09:57:58 (UTC+8)
28419CUDA0: 12GB / 48GB 98% || CUDA1: 13GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10698MB | CUDA1 PID:[1529811] 12974MB)260620-09:56:23 (UTC+8)
28418CUDA0: 12GB / 48GB 98% || CUDA1: 12GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10698MB | CUDA1 PID:[1529811] 12080MB)260620-09:54:49 (UTC+8)
28417CUDA0: 12GB / 48GB 98% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10698MB | CUDA1 PID:[1529811] 12080MB)260620-09:53:14 (UTC+8)
28416CUDA0: 12GB / 48GB 99% || CUDA1: 12GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10698MB | CUDA1 PID:[1529811] 12080MB)260620-09:51:39 (UTC+8)
28415CUDA0: 10GB / 48GB 97% || CUDA1: 11GB / 48GB 91% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8950MB | CUDA1 PID:[1529811] 11216MB)260620-09:50:04 (UTC+8)
28414CUDA0: 10GB / 48GB 96% || CUDA1: 11GB / 48GB 89% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8950MB | CUDA1 PID:[1529811] 11216MB)260620-09:48:29 (UTC+8)
28413CUDA0: 13GB / 48GB 98% || CUDA1: 10GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11796MB | CUDA1 PID:[1529811] 10382MB)260620-09:46:55 (UTC+8)
28412CUDA0: 13GB / 48GB 97% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11796MB | CUDA1 PID:[1529811] 9594MB)260620-09:45:20 (UTC+8)
28411CUDA0: 13GB / 48GB 97% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11796MB | CUDA1 PID:[1529811] 8806MB)260620-09:43:45 (UTC+8)
28410CUDA0: 13GB / 48GB 98% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11796MB | CUDA1 PID:[1529811] 8806MB)260620-09:42:10 (UTC+8)
28409CUDA0: 12GB / 48GB 97% || CUDA1: 8GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10824MB | CUDA1 PID:[1529811] 8054MB)260620-09:40:35 (UTC+8)
28408CUDA0: 12GB / 48GB 96% || CUDA1: 10GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10824MB | CUDA1 PID:[1529811] 10608MB)260620-09:39:01 (UTC+8)
28407CUDA0: 12GB / 48GB 97% || CUDA1: 10GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10824MB | CUDA1 PID:[1529811] 10608MB)260620-09:37:26 (UTC+8)
28406CUDA0: 11GB / 48GB 93% || CUDA1: 10GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9868MB | CUDA1 PID:[1529811] 10608MB)260620-09:35:51 (UTC+8)
28405CUDA0: 10GB / 48GB 98% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8968MB | CUDA1 PID:[1529811] 10608MB)260620-09:34:17 (UTC+8)
28404CUDA0: 10GB / 48GB 88% || CUDA1: 10GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8968MB | CUDA1 PID:[1529811] 10608MB)260620-09:32:42 (UTC+8)
28403CUDA0: 12GB / 48GB 98% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8002MB | CUDA1 PID:[1529811] 10608MB)260620-09:31:07 (UTC+8)
28402CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10608MB)260620-09:29:33 (UTC+8)
28401CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10608MB)260620-09:27:59 (UTC+8)
28400CUDA0: 12GB / 48GB 97% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10608MB)260620-09:26:24 (UTC+8)
28399CUDA0: 12GB / 48GB 99% || CUDA1: 9GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 8842MB)260620-09:24:49 (UTC+8)
28398CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10538MB)260620-09:23:15 (UTC+8)
28397CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 88% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10538MB)260620-09:21:41 (UTC+8)
28396CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10538MB)260620-09:20:06 (UTC+8)
28395CUDA0: 12GB / 48GB 99% || CUDA1: 10GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10726MB | CUDA1 PID:[1529811] 10538MB)260620-09:18:32 (UTC+8)
28394CUDA0: 11GB / 48GB 100% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9818MB | CUDA1 PID:[1529811] 10538MB)260620-09:16:57 (UTC+8)
28393CUDA0: 10GB / 48GB 98% || CUDA1: 10GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8960MB | CUDA1 PID:[1529811] 10538MB)260620-09:15:23 (UTC+8)
28392CUDA0: 12GB / 48GB 99% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 8818MB)260620-09:13:48 (UTC+8)
28391CUDA0: 12GB / 48GB 99% || CUDA1: 9GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 8818MB)260620-09:12:14 (UTC+8)
28390CUDA0: 12GB / 48GB 99% || CUDA1: 8GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 8054MB)260620-09:10:39 (UTC+8)
28389CUDA0: 12GB / 48GB 99% || CUDA1: 8GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 8054MB)260620-09:09:05 (UTC+8)
28388CUDA0: 12GB / 48GB 100% || CUDA1: 12GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 12350MB)260620-09:07:30 (UTC+8)
28387CUDA0: 12GB / 48GB 98% || CUDA1: 12GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 12350MB)260620-09:05:56 (UTC+8)
28386CUDA0: 12GB / 48GB 99% || CUDA1: 12GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10728MB | CUDA1 PID:[1529811] 12350MB)260620-09:04:21 (UTC+8)
28385CUDA0: 11GB / 48GB 99% || CUDA1: 19GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9742MB | CUDA1 PID:[1529811] 12350MB | CUDA1 PID:[1594643] 6604MB)260620-09:02:47 (UTC+8)
28384CUDA0: 11GB / 48GB 99% || CUDA1: 19GB / 48GB 96% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9742MB | CUDA1 PID:[1529811] 12350MB | CUDA1 PID:[1594643] 6604MB)260620-09:01:12 (UTC+8)
28383CUDA0: 11GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9742MB | CUDA1 PID:[1529811] 11376MB | CUDA1 PID:[1594643] 6604MB)260620-08:59:38 (UTC+8)
28382CUDA0: 14GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12232MB | CUDA1 PID:[1529811] 11376MB | CUDA1 PID:[1594643] 6604MB)260620-08:58:04 (UTC+8)
28381CUDA0: 14GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12232MB | CUDA1 PID:[1529811] 11376MB | CUDA1 PID:[1594643] 6604MB)260620-08:56:29 (UTC+8)
28380CUDA0: 14GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 12232MB | CUDA1 PID:[1529811] 11376MB | CUDA1 PID:[1594643] 6604MB)260620-08:54:55 (UTC+8)
28379CUDA0: 13GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11334MB | CUDA1 PID:[1529811] 11376MB | CUDA1 PID:[1594643] 6604MB)260620-08:53:20 (UTC+8)
28378CUDA0: 13GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11334MB | CUDA1 PID:[1529811] 10488MB | CUDA1 PID:[1594643] 6604MB)260620-08:51:46 (UTC+8)
28377CUDA0: 13GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11334MB | CUDA1 PID:[1529811] 10486MB | CUDA1 PID:[1594643] 6604MB)260620-08:50:11 (UTC+8)
28376CUDA0: 13GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11334MB | CUDA1 PID:[1529811] 10486MB | CUDA1 PID:[1594643] 6604MB)260620-08:48:37 (UTC+8)
28375CUDA0: 12GB / 48GB 99% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10484MB | CUDA1 PID:[1529811] 9646MB | CUDA1 PID:[1594643] 6604MB)260620-08:47:02 (UTC+8)
28374CUDA0: 11GB / 48GB 99% || CUDA1: 15GB / 48GB 94% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9680MB | CUDA1 PID:[1529811] 8860MB | CUDA1 PID:[1594643] 6604MB)260620-08:45:28 (UTC+8)
28373CUDA0: 10GB / 48GB 71% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8882MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:43:53 (UTC+8)
28372CUDA0: 15GB / 48GB 98% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 14018MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:42:19 (UTC+8)
28371CUDA0: 14GB / 48GB 96% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 13082MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:40:44 (UTC+8)
28370CUDA0: 14GB / 48GB 99% || CUDA1: 17GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 13082MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:39:10 (UTC+8)
28369CUDA0: 14GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 13082MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:37:35 (UTC+8)
28368CUDA0: 14GB / 48GB 100% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 13082MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:36:01 (UTC+8)
28367CUDA0: 13GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11332MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:34:27 (UTC+8)
28366CUDA0: 13GB / 48GB 97% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11332MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:32:52 (UTC+8)
28365CUDA0: 13GB / 48GB 70% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11332MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:31:18 (UTC+8)
28364CUDA0: 12GB / 48GB 97% || CUDA1: 17GB / 48GB 97% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10502MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:29:43 (UTC+8)
28363CUDA0: 12GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10502MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:28:09 (UTC+8)
28362CUDA0: 10GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8882MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:26:34 (UTC+8)
28361CUDA0: 13GB / 48GB 98% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11694MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:25:00 (UTC+8)
28360CUDA0: 13GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11694MB | CUDA1 PID:[1529811] 10616MB | CUDA1 PID:[1594643] 6604MB)260620-08:23:25 (UTC+8)
28359CUDA0: 13GB / 48GB 95% || CUDA1: 16GB / 48GB 99% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11694MB | CUDA1 PID:[1529811] 9678MB | CUDA1 PID:[1594643] 6604MB)260620-08:21:51 (UTC+8)
28358CUDA0: 13GB / 48GB 97% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 11694MB | CUDA1 PID:[1529811] 9678MB | CUDA1 PID:[1594643] 6604MB)260620-08:20:16 (UTC+8)
28357CUDA0: 12GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10720MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1594643] 6604MB)260620-08:18:42 (UTC+8)
28356CUDA0: 12GB / 48GB 98% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10720MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1594643] 6604MB)260620-08:17:07 (UTC+8)
28355CUDA0: 12GB / 48GB 99% || CUDA1: 18GB / 48GB 98% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10720MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1594643] 6604MB)260620-08:15:32 (UTC+8)
28354CUDA0: 12GB / 48GB 65% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10720MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1594643] 6604MB)260620-08:13:58 (UTC+8)
28353CUDA0: 12GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10720MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1522417] 6604MB)260620-08:12:23 (UTC+8)
28352CUDA0: 11GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9772MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1522417] 6604MB)260620-08:10:49 (UTC+8)
28351CUDA0: 12GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 10810MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1522417] 6604MB)260620-08:09:15 (UTC+8)
28350CUDA0: 11GB / 48GB 100% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1522417] 6604MB)260620-08:07:40 (UTC+8)
28349CUDA0: 11GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1522417] 6604MB)260620-08:06:06 (UTC+8)
28348CUDA0: 11GB / 48GB 99% || CUDA1: 18GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 11608MB | CUDA1 PID:[1522417] 6604MB)260620-08:04:31 (UTC+8)
28347CUDA0: 11GB / 48GB 99% || CUDA1: 17GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 10650MB | CUDA1 PID:[1522417] 6604MB)260620-08:02:57 (UTC+8)
28346CUDA0: 11GB / 48GB 97% || CUDA1: 16GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 9702MB | CUDA1 PID:[1522417] 6604MB)260620-08:01:22 (UTC+8)
28345CUDA0: 11GB / 48GB 97% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 8896MB | CUDA1 PID:[1522417] 6604MB)260620-07:59:48 (UTC+8)
28344CUDA0: 11GB / 48GB 99% || CUDA1: 15GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 8892MB | CUDA1 PID:[1522417] 6604MB)260620-07:58:13 (UTC+8)
28343CUDA0: 11GB / 48GB 98% || CUDA1: 14GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 9824MB | CUDA1 PID:[1529811] 8054MB | CUDA1 PID:[1522417] 6604MB)260620-07:56:39 (UTC+8)
28342CUDA0: 10GB / 48GB 97% || CUDA1: 14GB / 48GB 100% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 8882MB | CUDA1 PID:[1529811] 8054MB | CUDA1 PID:[1522417] 6604MB)260620-07:55:04 (UTC+8)
28341CUDA0: 9GB / 48GB 0% || CUDA1: 14GB / 48GB 85% [双卡负载] (高占用进程: CUDA0 PID:[1529776] 7784MB | CUDA1 PID:[1529811] 7784MB | CUDA1 PID:[1522417] 6604MB)260620-07:53:30 (UTC+8)
28340CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[1522417] 6604MB)260620-07:51:55 (UTC+8)
28339CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 95% [双卡负载] (高占用进程: CUDA1 PID:[1522417] 6604MB)260620-07:50:21 (UTC+8)
28338CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 85% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:48:46 (UTC+8)
28337CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 96% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:47:12 (UTC+8)
28336CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 83% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:45:37 (UTC+8)
28335CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 87% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:44:03 (UTC+8)
28334CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 82% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:42:28 (UTC+8)
28333CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 83% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:40:54 (UTC+8)
28332CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 88% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:39:20 (UTC+8)
28331CUDA0: 2GB / 48GB 0% || CUDA1: 6GB / 48GB 97% [双卡负载] (高占用进程: CUDA1 PID:[1473723] 6604MB)260620-07:37:45 (UTC+8)
#02

PubMed6666Resume7166CUDA0

▦ table
last update
260621-21:26:07
records
816
type
text
latest
resume run 完成:SFT/P4/P5/Poly/01-13 已处理 260621-21:26:05 (UTC+8)
ID数值接收时间
816resume run 完成:SFT/P4/P5/Poly/01-13 已处理 260621-21:26:05 (UTC+8)260621-21:26:07 (UTC+8)
815done collect_results_all 260621-21:26:04 (UTC+8)260621-21:26:06 (UTC+8)
814start collect_results_all 260621-21:26:03 (UTC+8)260621-21:26:05 (UTC+8)
813done Remaining_01_to_13_standard_matrix 260621-21:26:02 (UTC+8)260621-21:26:04 (UTC+8)
81213_OnlyInvForce 完成:Val=90.08 Test=90.21 MLP=89.12 GNN=88.64 260621-21:26:00 (UTC+8)260621-21:26:01 (UTC+8)
81113_OnlyInvForce Phase2 完成:Val=90.08 Test=90.21 best_epoch=740 260621-21:25:59 (UTC+8)260621-21:26:00 (UTC+8)
81013_OnlyInvForce Phase2 epoch=1700/1706 Val=87.88 Test=88.16 best=90.08@740 260621-21:25:57 (UTC+8)260621-21:25:59 (UTC+8)
80913_OnlyInvForce Phase2 epoch=1600/1706 Val=89.17 Test=89.35 best=90.08@740 260621-21:25:55 (UTC+8)260621-21:25:57 (UTC+8)
80813_OnlyInvForce Phase2 epoch=1500/1706 Val=88.92 Test=89.53 best=90.08@740 260621-21:25:53 (UTC+8)260621-21:25:55 (UTC+8)
80713_OnlyInvForce Phase2 epoch=1400/1706 Val=89.07 Test=89.76 best=90.08@740 260621-21:25:51 (UTC+8)260621-21:25:53 (UTC+8)
80613_OnlyInvForce Phase2 epoch=1300/1706 Val=89.30 Test=90.19 best=90.08@740 260621-21:25:49 (UTC+8)260621-21:25:50 (UTC+8)
80513_OnlyInvForce Phase2 epoch=1200/1706 Val=89.42 Test=90.37 best=90.08@740 260621-21:25:47 (UTC+8)260621-21:25:48 (UTC+8)
80413_OnlyInvForce Phase2 epoch=1100/1706 Val=89.91 Test=90.49 best=90.08@740 260621-21:25:45 (UTC+8)260621-21:25:46 (UTC+8)
80313_OnlyInvForce Phase2 epoch=900/1706 Val=89.80 Test=90.16 best=90.08@740 260621-21:25:36 (UTC+8)260621-21:25:37 (UTC+8)
80213_OnlyInvForce Phase2 epoch=800/1706 Val=85.72 Test=85.83 best=90.08@740 260621-21:25:33 (UTC+8)260621-21:25:35 (UTC+8)
80113_OnlyInvForce Phase2 epoch=700/1706 Val=89.60 Test=90.11 best=90.03@655 260621-21:25:31 (UTC+8)260621-21:25:33 (UTC+8)
80013_OnlyInvForce Phase2 epoch=600/1706 Val=89.60 Test=90.44 best=89.86@525 260621-21:25:30 (UTC+8)260621-21:25:31 (UTC+8)
79913_OnlyInvForce Phase2 epoch=400/1706 Val=88.59 Test=89.00 best=89.40@365 260621-21:25:21 (UTC+8)260621-21:25:23 (UTC+8)
79813_OnlyInvForce Phase2 epoch=300/1706 Val=88.61 Test=89.22 best=88.64@165 260621-21:25:19 (UTC+8)260621-21:25:21 (UTC+8)
79713_OnlyInvForce Phase2 epoch=200/1706 Val=88.28 Test=88.87 best=88.64@165 260621-21:25:17 (UTC+8)260621-21:25:18 (UTC+8)
79613_OnlyInvForce Phase2 epoch=100/1706 Val=87.50 Test=87.91 best=87.95@95 260621-21:25:15 (UTC+8)260621-21:25:16 (UTC+8)
79513_OnlyInvForce Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-21:25:14 (UTC+8)260621-21:25:14 (UTC+8)
79413_OnlyInvForce Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-21:25:13 (UTC+8)260621-21:25:14 (UTC+8)
79313_OnlyInvForce Phase1 完成:best=42.00@1153 targets=19717 260621-21:25:10 (UTC+8)260621-21:25:11 (UTC+8)
79213_OnlyInvForce Phase1 epoch=2100/2256 best=42.00@1153 260621-21:24:33 (UTC+8)260621-21:24:34 (UTC+8)
79113_OnlyInvForce Phase1 epoch=2000/2256 best=42.00@1153 260621-21:24:12 (UTC+8)260621-21:24:14 (UTC+8)
79013_OnlyInvForce Phase1 epoch=1900/2256 best=42.00@1153 260621-21:23:53 (UTC+8)260621-21:23:53 (UTC+8)
78913_OnlyInvForce Phase1 epoch=1800/2256 best=42.00@1153 260621-21:23:32 (UTC+8)260621-21:23:33 (UTC+8)
78813_OnlyInvForce Phase1 epoch=1700/2256 best=42.00@1153 260621-21:23:11 (UTC+8)260621-21:23:12 (UTC+8)
78713_OnlyInvForce Phase1 epoch=1600/2256 best=42.00@1153 260621-21:22:51 (UTC+8)260621-21:22:52 (UTC+8)
78613_OnlyInvForce Phase1 epoch=1500/2256 best=42.00@1153 260621-21:22:30 (UTC+8)260621-21:22:31 (UTC+8)
78513_OnlyInvForce Phase1 epoch=1400/2256 best=42.00@1153 260621-21:22:03 (UTC+8)260621-21:22:04 (UTC+8)
78413_OnlyInvForce Phase1 epoch=1200/2256 best=42.00@1153 260621-21:21:07 (UTC+8)260621-21:21:08 (UTC+8)
78313_OnlyInvForce Phase1 epoch=1100/2256 best=39.46@1087 260621-21:20:40 (UTC+8)260621-21:20:41 (UTC+8)
78213_OnlyInvForce Phase1 epoch=1000/2256 best=39.44@5 260621-21:20:14 (UTC+8)260621-21:20:15 (UTC+8)
78113_OnlyInvForce Phase1 epoch=900/2256 best=39.44@5 260621-21:19:46 (UTC+8)260621-21:19:48 (UTC+8)
78013_OnlyInvForce Phase1 epoch=800/2256 best=39.44@5 260621-21:19:20 (UTC+8)260621-21:19:21 (UTC+8)
77913_OnlyInvForce Phase1 epoch=700/2256 best=39.44@5 260621-21:18:53 (UTC+8)260621-21:18:54 (UTC+8)
77813_OnlyInvForce Phase1 epoch=600/2256 best=39.44@5 260621-21:18:26 (UTC+8)260621-21:18:27 (UTC+8)
77713_OnlyInvForce Phase1 epoch=500/2256 best=39.44@5 260621-21:17:59 (UTC+8)260621-21:18:00 (UTC+8)
77613_OnlyInvForce Phase1 epoch=400/2256 best=39.44@5 260621-21:17:34 (UTC+8)260621-21:17:34 (UTC+8)
77513_OnlyInvForce Phase1 epoch=300/2256 best=39.44@5 260621-21:17:06 (UTC+8)260621-21:17:07 (UTC+8)
77413_OnlyInvForce Phase1 epoch=200/2256 best=39.44@5 260621-21:16:39 (UTC+8)260621-21:16:40 (UTC+8)
77313_OnlyInvForce Phase1 epoch=100/2256 best=39.44@5 260621-21:16:12 (UTC+8)260621-21:16:14 (UTC+8)
77213_OnlyInvForce Phase1 epoch=1/2256 best=39.28@1 260621-21:15:46 (UTC+8)260621-21:15:48 (UTC+8)
77113_OnlyInvForce Phase1 启动:Three-force ablation: invariance only 260621-21:15:45 (UTC+8)260621-21:15:47 (UTC+8)
77013_OnlyInvForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-21:15:41 (UTC+8)260621-21:15:42 (UTC+8)
76912_OnlyIBForce 完成:Val=90.51 Test=90.80 MLP=88.92 GNN=89.07 260621-21:15:36 (UTC+8)260621-21:15:38 (UTC+8)
76812_OnlyIBForce Phase2 完成:Val=90.51 Test=90.80 best_epoch=600 260621-21:15:36 (UTC+8)260621-21:15:37 (UTC+8)
76712_OnlyIBForce Phase2 epoch=1700/1706 Val=88.36 Test=89.15 best=90.51@600 260621-21:15:35 (UTC+8)260621-21:15:36 (UTC+8)
76612_OnlyIBForce Phase2 epoch=1600/1706 Val=81.54 Test=80.32 best=90.51@600 260621-21:15:33 (UTC+8)260621-21:15:34 (UTC+8)
76512_OnlyIBForce Phase2 epoch=1500/1706 Val=88.64 Test=88.26 best=90.51@600 260621-21:15:30 (UTC+8)260621-21:15:32 (UTC+8)
76412_OnlyIBForce Phase2 epoch=1400/1706 Val=89.09 Test=89.00 best=90.51@600 260621-21:15:29 (UTC+8)260621-21:15:30 (UTC+8)
76312_OnlyIBForce Phase2 epoch=1300/1706 Val=88.18 Test=88.26 best=90.51@600 260621-21:15:27 (UTC+8)260621-21:15:28 (UTC+8)
76212_OnlyIBForce Phase2 epoch=1200/1706 Val=88.51 Test=88.74 best=90.51@600 260621-21:15:25 (UTC+8)260621-21:15:26 (UTC+8)
76112_OnlyIBForce Phase2 epoch=1100/1706 Val=88.74 Test=89.02 best=90.51@600 260621-21:15:23 (UTC+8)260621-21:15:24 (UTC+8)
76012_OnlyIBForce Phase2 epoch=1000/1706 Val=88.94 Test=89.02 best=90.51@600 260621-21:15:21 (UTC+8)260621-21:15:22 (UTC+8)
75912_OnlyIBForce Phase2 epoch=900/1706 Val=89.73 Test=89.60 best=90.51@600 260621-21:15:19 (UTC+8)260621-21:15:20 (UTC+8)
75812_OnlyIBForce Phase2 epoch=800/1706 Val=89.70 Test=89.78 best=90.51@600 260621-21:15:16 (UTC+8)260621-21:15:17 (UTC+8)
75712_OnlyIBForce Phase2 epoch=700/1706 Val=89.45 Test=89.55 best=90.51@600 260621-21:15:13 (UTC+8)260621-21:15:15 (UTC+8)
75612_OnlyIBForce Phase2 epoch=600/1706 Val=90.51 Test=90.80 best=90.51@600 260621-21:15:11 (UTC+8)260621-21:15:13 (UTC+8)
75512_OnlyIBForce Phase2 epoch=500/1706 Val=90.34 Test=90.62 best=90.34@500 260621-21:15:09 (UTC+8)260621-21:15:11 (UTC+8)
75412_OnlyIBForce Phase2 epoch=400/1706 Val=89.96 Test=90.24 best=90.16@315 260621-21:15:07 (UTC+8)260621-21:15:09 (UTC+8)
75312_OnlyIBForce Phase2 epoch=300/1706 Val=89.93 Test=90.06 best=89.96@295 260621-21:15:05 (UTC+8)260621-21:15:06 (UTC+8)
75212_OnlyIBForce Phase2 epoch=200/1706 Val=88.92 Test=89.38 best=89.27@135 260621-21:15:03 (UTC+8)260621-21:15:04 (UTC+8)
75112_OnlyIBForce Phase2 epoch=100/1706 Val=86.41 Test=86.56 best=88.18@75 260621-21:15:00 (UTC+8)260621-21:15:02 (UTC+8)
75012_OnlyIBForce Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-21:14:58 (UTC+8)260621-21:15:00 (UTC+8)
74912_OnlyIBForce Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-21:14:57 (UTC+8)260621-21:14:59 (UTC+8)
74812_OnlyIBForce Phase1 完成:best=43.22@29 targets=19717 260621-21:14:54 (UTC+8)260621-21:14:56 (UTC+8)
74712_OnlyIBForce Phase1 epoch=2200/2256 best=43.22@29 260621-21:14:42 (UTC+8)260621-21:14:43 (UTC+8)
74612_OnlyIBForce Phase1 epoch=2100/2256 best=43.22@29 260621-21:14:21 (UTC+8)260621-21:14:22 (UTC+8)
74512_OnlyIBForce Phase1 epoch=2000/2256 best=43.22@29 260621-21:14:00 (UTC+8)260621-21:14:02 (UTC+8)
74412_OnlyIBForce Phase1 epoch=1900/2256 best=43.22@29 260621-21:13:40 (UTC+8)260621-21:13:41 (UTC+8)
74312_OnlyIBForce Phase1 epoch=1800/2256 best=43.22@29 260621-21:13:19 (UTC+8)260621-21:13:21 (UTC+8)
74212_OnlyIBForce Phase1 epoch=1700/2256 best=43.22@29 260621-21:12:59 (UTC+8)260621-21:13:00 (UTC+8)
74112_OnlyIBForce Phase1 epoch=1600/2256 best=43.22@29 260621-21:12:38 (UTC+8)260621-21:12:39 (UTC+8)
74012_OnlyIBForce Phase1 epoch=1500/2256 best=43.22@29 260621-21:12:17 (UTC+8)260621-21:12:19 (UTC+8)
73912_OnlyIBForce Phase1 epoch=1400/2256 best=43.22@29 260621-21:11:52 (UTC+8)260621-21:11:52 (UTC+8)
73812_OnlyIBForce Phase1 epoch=1300/2256 best=43.22@29 260621-21:11:25 (UTC+8)260621-21:11:26 (UTC+8)
73712_OnlyIBForce Phase1 epoch=1100/2256 best=43.22@29 260621-21:10:28 (UTC+8)260621-21:10:28 (UTC+8)
73612_OnlyIBForce Phase1 epoch=1000/2256 best=43.22@29 260621-21:10:01 (UTC+8)260621-21:10:03 (UTC+8)
73512_OnlyIBForce Phase1 epoch=900/2256 best=43.22@29 260621-21:09:35 (UTC+8)260621-21:09:36 (UTC+8)
73412_OnlyIBForce Phase1 epoch=800/2256 best=43.22@29 260621-21:09:08 (UTC+8)260621-21:09:09 (UTC+8)
73312_OnlyIBForce Phase1 epoch=700/2256 best=43.22@29 260621-21:08:40 (UTC+8)260621-21:08:42 (UTC+8)
73212_OnlyIBForce Phase1 epoch=600/2256 best=43.22@29 260621-21:08:13 (UTC+8)260621-21:08:15 (UTC+8)
73112_OnlyIBForce Phase1 epoch=500/2256 best=43.22@29 260621-21:07:45 (UTC+8)260621-21:07:47 (UTC+8)
73012_OnlyIBForce Phase1 epoch=400/2256 best=43.22@29 260621-21:07:21 (UTC+8)260621-21:07:21 (UTC+8)
72912_OnlyIBForce Phase1 epoch=300/2256 best=43.22@29 260621-21:06:53 (UTC+8)260621-21:06:54 (UTC+8)
72812_OnlyIBForce Phase1 epoch=200/2256 best=43.22@29 260621-21:06:25 (UTC+8)260621-21:06:27 (UTC+8)
72712_OnlyIBForce Phase1 epoch=100/2256 best=43.22@29 260621-21:05:58 (UTC+8)260621-21:06:00 (UTC+8)
72612_OnlyIBForce Phase1 epoch=1/2256 best=25.13@1 260621-21:05:34 (UTC+8)260621-21:05:34 (UTC+8)
72512_OnlyIBForce Phase1 启动:Three-force ablation: bottleneck only 260621-21:05:30 (UTC+8)260621-21:05:33 (UTC+8)
72412_OnlyIBForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-21:05:25 (UTC+8)260621-21:05:28 (UTC+8)
72311_OnlyPredForce 完成:Val=93.63 Test=92.82 MLP=92.42 GNN=90.95 260621-21:05:21 (UTC+8)260621-21:05:23 (UTC+8)
72211_OnlyPredForce Phase2 完成:Val=93.63 Test=92.82 best_epoch=510 260621-21:05:20 (UTC+8)260621-21:05:23 (UTC+8)
72111_OnlyPredForce Phase2 epoch=1700/1706 Val=93.05 Test=92.70 best=93.63@510 260621-21:05:19 (UTC+8)260621-21:05:22 (UTC+8)
72011_OnlyPredForce Phase2 epoch=1600/1706 Val=92.39 Test=92.11 best=93.63@510 260621-21:05:17 (UTC+8)260621-21:05:19 (UTC+8)
71911_OnlyPredForce Phase2 epoch=1500/1706 Val=92.47 Test=92.32 best=93.63@510 260621-21:05:15 (UTC+8)260621-21:05:17 (UTC+8)
71811_OnlyPredForce Phase2 epoch=1400/1706 Val=93.10 Test=92.55 best=93.63@510 260621-21:05:13 (UTC+8)260621-21:05:15 (UTC+8)
71711_OnlyPredForce Phase2 epoch=1300/1706 Val=92.87 Test=92.60 best=93.63@510 260621-21:05:11 (UTC+8)260621-21:05:13 (UTC+8)
71611_OnlyPredForce Phase2 epoch=1200/1706 Val=92.72 Test=92.47 best=93.63@510 260621-21:05:09 (UTC+8)260621-21:05:10 (UTC+8)
71511_OnlyPredForce Phase2 epoch=1100/1706 Val=92.29 Test=91.91 best=93.63@510 260621-21:05:07 (UTC+8)260621-21:05:09 (UTC+8)
71411_OnlyPredForce Phase2 epoch=1000/1706 Val=93.30 Test=93.08 best=93.63@510 260621-21:05:05 (UTC+8)260621-21:05:07 (UTC+8)
71311_OnlyPredForce Phase2 epoch=900/1706 Val=92.90 Test=92.70 best=93.63@510 260621-21:05:03 (UTC+8)260621-21:05:04 (UTC+8)
71211_OnlyPredForce Phase2 epoch=800/1706 Val=92.85 Test=92.85 best=93.63@510 260621-21:05:01 (UTC+8)260621-21:05:02 (UTC+8)
71111_OnlyPredForce Phase2 epoch=700/1706 Val=93.13 Test=93.10 best=93.63@510 260621-21:04:59 (UTC+8)260621-21:05:00 (UTC+8)
71011_OnlyPredForce Phase2 epoch=600/1706 Val=92.95 Test=92.85 best=93.63@510 260621-21:04:57 (UTC+8)260621-21:04:58 (UTC+8)
70911_OnlyPredForce Phase2 epoch=500/1706 Val=93.41 Test=93.13 best=93.56@345 260621-21:04:55 (UTC+8)260621-21:04:56 (UTC+8)
70811_OnlyPredForce Phase2 epoch=400/1706 Val=93.33 Test=93.08 best=93.56@345 260621-21:04:53 (UTC+8)260621-21:04:54 (UTC+8)
70711_OnlyPredForce Phase2 epoch=300/1706 Val=93.13 Test=92.88 best=93.13@300 260621-21:04:51 (UTC+8)260621-21:04:52 (UTC+8)
70611_OnlyPredForce Phase2 epoch=200/1706 Val=91.71 Test=91.86 best=92.32@185 260621-21:04:47 (UTC+8)260621-21:04:49 (UTC+8)
70511_OnlyPredForce Phase2 epoch=100/1706 Val=89.91 Test=90.21 best=89.91@100 260621-21:04:45 (UTC+8)260621-21:04:46 (UTC+8)
70411_OnlyPredForce Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-21:04:43 (UTC+8)260621-21:04:44 (UTC+8)
70311_OnlyPredForce Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-21:04:41 (UTC+8)260621-21:04:43 (UTC+8)
70211_OnlyPredForce Phase1 完成:best=92.97@264 targets=19717 260621-21:04:38 (UTC+8)260621-21:04:40 (UTC+8)
70111_OnlyPredForce Phase1 epoch=2200/2256 best=92.97@264 260621-21:04:27 (UTC+8)260621-21:04:28 (UTC+8)
70011_OnlyPredForce Phase1 epoch=2100/2256 best=92.97@264 260621-21:04:05 (UTC+8)260621-21:04:07 (UTC+8)
69911_OnlyPredForce Phase1 epoch=2000/2256 best=92.97@264 260621-21:03:45 (UTC+8)260621-21:03:46 (UTC+8)
69811_OnlyPredForce Phase1 epoch=1900/2256 best=92.97@264 260621-21:03:22 (UTC+8)260621-21:03:25 (UTC+8)
69711_OnlyPredForce Phase1 epoch=1800/2256 best=92.97@264 260621-21:03:03 (UTC+8)260621-21:03:03 (UTC+8)
69611_OnlyPredForce Phase1 epoch=1700/2256 best=92.97@264 260621-21:02:40 (UTC+8)260621-21:02:41 (UTC+8)
69511_OnlyPredForce Phase1 epoch=1600/2256 best=92.97@264 260621-21:02:18 (UTC+8)260621-21:02:20 (UTC+8)
69411_OnlyPredForce Phase1 epoch=1500/2256 best=92.97@264 260621-21:01:59 (UTC+8)260621-21:02:01 (UTC+8)
69311_OnlyPredForce Phase1 epoch=1400/2256 best=92.97@264 260621-21:01:32 (UTC+8)260621-21:01:34 (UTC+8)
69211_OnlyPredForce Phase1 epoch=1300/2256 best=92.97@264 260621-21:01:06 (UTC+8)260621-21:01:07 (UTC+8)
69111_OnlyPredForce Phase1 epoch=1200/2256 best=92.97@264 260621-21:00:40 (UTC+8)260621-21:00:41 (UTC+8)
69011_OnlyPredForce Phase1 epoch=1100/2256 best=92.97@264 260621-21:00:12 (UTC+8)260621-21:00:14 (UTC+8)
68911_OnlyPredForce Phase1 epoch=1000/2256 best=92.97@264 260621-20:59:45 (UTC+8)260621-20:59:47 (UTC+8)
68811_OnlyPredForce Phase1 epoch=900/2256 best=92.97@264 260621-20:59:20 (UTC+8)260621-20:59:21 (UTC+8)
68711_OnlyPredForce Phase1 epoch=800/2256 best=92.97@264 260621-20:58:47 (UTC+8)260621-20:58:49 (UTC+8)
68611_OnlyPredForce Phase1 epoch=700/2256 best=92.97@264 260621-20:58:21 (UTC+8)260621-20:58:23 (UTC+8)
68511_OnlyPredForce Phase1 epoch=600/2256 best=92.97@264 260621-20:57:55 (UTC+8)260621-20:57:56 (UTC+8)
68411_OnlyPredForce Phase1 epoch=500/2256 best=92.97@264 260621-20:57:27 (UTC+8)260621-20:57:29 (UTC+8)
68311_OnlyPredForce Phase1 epoch=400/2256 best=92.97@264 260621-20:57:02 (UTC+8)260621-20:57:03 (UTC+8)
68211_OnlyPredForce Phase1 epoch=300/2256 best=92.97@264 260621-20:56:35 (UTC+8)260621-20:56:36 (UTC+8)
68111_OnlyPredForce Phase1 epoch=200/2256 best=92.90@181 260621-20:56:09 (UTC+8)260621-20:56:10 (UTC+8)
68011_OnlyPredForce Phase1 epoch=100/2256 best=92.85@19 260621-20:55:41 (UTC+8)260621-20:55:43 (UTC+8)
67911_OnlyPredForce Phase1 epoch=1/2256 best=39.87@1 260621-20:55:16 (UTC+8)260621-20:55:17 (UTC+8)
67811_OnlyPredForce Phase1 启动:Three-force ablation: prediction only 260621-20:55:14 (UTC+8)260621-20:55:16 (UTC+8)
67711_OnlyPredForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-20:55:09 (UTC+8)260621-20:55:11 (UTC+8)
67610_NoInvForce 完成:Val=93.91 Test=93.13 MLP=92.17 GNN=92.47 260621-20:55:05 (UTC+8)260621-20:55:06 (UTC+8)
67510_NoInvForce Phase2 完成:Val=93.91 Test=93.13 best_epoch=935 260621-20:55:04 (UTC+8)260621-20:55:05 (UTC+8)
67410_NoInvForce Phase2 epoch=1700/1706 Val=93.08 Test=93.74 best=93.91@935 260621-20:55:03 (UTC+8)260621-20:55:04 (UTC+8)
67310_NoInvForce Phase2 epoch=1500/1706 Val=93.56 Test=93.53 best=93.91@935 260621-20:54:54 (UTC+8)260621-20:54:55 (UTC+8)
67210_NoInvForce Phase2 epoch=1400/1706 Val=92.44 Test=92.57 best=93.91@935 260621-20:54:53 (UTC+8)260621-20:54:53 (UTC+8)
67110_NoInvForce Phase2 epoch=1300/1706 Val=93.66 Test=93.36 best=93.91@935 260621-20:54:51 (UTC+8)260621-20:54:51 (UTC+8)
67010_NoInvForce Phase2 epoch=1200/1706 Val=93.20 Test=93.23 best=93.91@935 260621-20:54:49 (UTC+8)260621-20:54:49 (UTC+8)
66910_NoInvForce Phase2 epoch=1100/1706 Val=93.41 Test=93.97 best=93.91@935 260621-20:54:47 (UTC+8)260621-20:54:47 (UTC+8)
66810_NoInvForce Phase2 epoch=1000/1706 Val=93.36 Test=93.36 best=93.91@935 260621-20:54:45 (UTC+8)260621-20:54:46 (UTC+8)
66710_NoInvForce Phase2 epoch=900/1706 Val=93.23 Test=93.48 best=93.56@620 260621-20:54:41 (UTC+8)260621-20:54:43 (UTC+8)
66610_NoInvForce Phase2 epoch=800/1706 Val=92.97 Test=93.18 best=93.56@620 260621-20:54:39 (UTC+8)260621-20:54:41 (UTC+8)
66510_NoInvForce Phase2 epoch=600/1706 Val=92.26 Test=92.22 best=93.10@550 260621-20:54:30 (UTC+8)260621-20:54:32 (UTC+8)
66410_NoInvForce Phase2 epoch=400/1706 Val=92.04 Test=92.29 best=92.24@345 260621-20:54:22 (UTC+8)260621-20:54:23 (UTC+8)
66310_NoInvForce Phase2 epoch=300/1706 Val=91.48 Test=91.76 best=91.88@270 260621-20:54:20 (UTC+8)260621-20:54:21 (UTC+8)
66210_NoInvForce Phase2 epoch=200/1706 Val=90.03 Test=89.58 best=91.10@195 260621-20:54:18 (UTC+8)260621-20:54:19 (UTC+8)
66110_NoInvForce Phase2 epoch=100/1706 Val=89.02 Test=89.83 best=89.09@90 260621-20:54:16 (UTC+8)260621-20:54:17 (UTC+8)
66010_NoInvForce Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-20:54:14 (UTC+8)260621-20:54:15 (UTC+8)
65910_NoInvForce Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-20:54:13 (UTC+8)260621-20:54:14 (UTC+8)
65810_NoInvForce Phase1 完成:best=93.15@247 targets=19717 260621-20:54:08 (UTC+8)260621-20:54:11 (UTC+8)
65710_NoInvForce Phase1 epoch=2200/2256 best=93.15@247 260621-20:53:57 (UTC+8)260621-20:53:59 (UTC+8)
65610_NoInvForce Phase1 epoch=2100/2256 best=93.15@247 260621-20:53:36 (UTC+8)260621-20:53:37 (UTC+8)
65510_NoInvForce Phase1 epoch=2000/2256 best=93.15@247 260621-20:53:15 (UTC+8)260621-20:53:16 (UTC+8)
65410_NoInvForce Phase1 epoch=1900/2256 best=93.15@247 260621-20:52:55 (UTC+8)260621-20:52:56 (UTC+8)
65310_NoInvForce Phase1 epoch=1800/2256 best=93.15@247 260621-20:52:34 (UTC+8)260621-20:52:35 (UTC+8)
65210_NoInvForce Phase1 epoch=1700/2256 best=93.15@247 260621-20:52:13 (UTC+8)260621-20:52:13 (UTC+8)
65110_NoInvForce Phase1 epoch=1600/2256 best=93.15@247 260621-20:51:51 (UTC+8)260621-20:51:52 (UTC+8)
65010_NoInvForce Phase1 epoch=1500/2256 best=93.15@247 260621-20:51:31 (UTC+8)260621-20:51:33 (UTC+8)
64910_NoInvForce Phase1 epoch=1400/2256 best=93.15@247 260621-20:51:05 (UTC+8)260621-20:51:05 (UTC+8)
64810_NoInvForce Phase1 epoch=1300/2256 best=93.15@247 260621-20:50:37 (UTC+8)260621-20:50:38 (UTC+8)
64710_NoInvForce Phase1 epoch=1200/2256 best=93.15@247 260621-20:50:11 (UTC+8)260621-20:50:12 (UTC+8)
64610_NoInvForce Phase1 epoch=1100/2256 best=93.15@247 260621-20:49:43 (UTC+8)260621-20:49:45 (UTC+8)
64510_NoInvForce Phase1 epoch=1000/2256 best=93.15@247 260621-20:49:17 (UTC+8)260621-20:49:19 (UTC+8)
64410_NoInvForce Phase1 epoch=900/2256 best=93.15@247 260621-20:48:52 (UTC+8)260621-20:48:53 (UTC+8)
64310_NoInvForce Phase1 epoch=800/2256 best=93.15@247 260621-20:48:24 (UTC+8)260621-20:48:25 (UTC+8)
64210_NoInvForce Phase1 epoch=700/2256 best=93.15@247 260621-20:47:58 (UTC+8)260621-20:47:59 (UTC+8)
64110_NoInvForce Phase1 epoch=600/2256 best=93.15@247 260621-20:47:30 (UTC+8)260621-20:47:32 (UTC+8)
64010_NoInvForce Phase1 epoch=500/2256 best=93.15@247 260621-20:47:04 (UTC+8)260621-20:47:05 (UTC+8)
63910_NoInvForce Phase1 epoch=400/2256 best=93.15@247 260621-20:46:38 (UTC+8)260621-20:46:39 (UTC+8)
63810_NoInvForce Phase1 epoch=300/2256 best=93.15@247 260621-20:46:12 (UTC+8)260621-20:46:12 (UTC+8)
63710_NoInvForce Phase1 epoch=200/2256 best=93.05@138 260621-20:45:45 (UTC+8)260621-20:45:46 (UTC+8)
63610_NoInvForce Phase1 epoch=100/2256 best=92.95@90 260621-20:45:18 (UTC+8)260621-20:45:19 (UTC+8)
63510_NoInvForce Phase1 epoch=1/2256 best=39.84@1 260621-20:44:52 (UTC+8)260621-20:44:53 (UTC+8)
63410_NoInvForce Phase1 启动:Three-force ablation: no invariance force 260621-20:44:50 (UTC+8)260621-20:44:52 (UTC+8)
63310_NoInvForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-20:44:45 (UTC+8)260621-20:44:46 (UTC+8)
63209_NoIBForce 完成:Val=93.86 Test=93.23 MLP=92.75 GNN=92.44 260621-20:44:41 (UTC+8)260621-20:44:42 (UTC+8)
63109_NoIBForce Phase2 完成:Val=93.86 Test=93.23 best_epoch=1290 260621-20:44:40 (UTC+8)260621-20:44:41 (UTC+8)
63009_NoIBForce Phase2 epoch=1700/1706 Val=93.74 Test=93.64 best=93.86@1290 260621-20:44:39 (UTC+8)260621-20:44:40 (UTC+8)
62909_NoIBForce Phase2 epoch=1600/1706 Val=93.66 Test=93.51 best=93.86@1290 260621-20:44:37 (UTC+8)260621-20:44:38 (UTC+8)
62809_NoIBForce Phase2 epoch=1500/1706 Val=93.46 Test=93.03 best=93.86@1290 260621-20:44:35 (UTC+8)260621-20:44:36 (UTC+8)
62709_NoIBForce Phase2 epoch=1400/1706 Val=93.38 Test=92.88 best=93.86@1290 260621-20:44:33 (UTC+8)260621-20:44:33 (UTC+8)
62609_NoIBForce Phase2 epoch=1300/1706 Val=93.46 Test=93.08 best=93.86@1290 260621-20:44:31 (UTC+8)260621-20:44:31 (UTC+8)
62509_NoIBForce Phase2 epoch=1200/1706 Val=93.71 Test=93.69 best=93.79@700 260621-20:44:29 (UTC+8)260621-20:44:29 (UTC+8)
62409_NoIBForce Phase2 epoch=1100/1706 Val=92.90 Test=92.37 best=93.79@700 260621-20:44:25 (UTC+8)260621-20:44:27 (UTC+8)
62309_NoIBForce Phase2 epoch=1000/1706 Val=93.33 Test=93.05 best=93.79@700 260621-20:44:23 (UTC+8)260621-20:44:25 (UTC+8)
62209_NoIBForce Phase2 epoch=900/1706 Val=93.41 Test=93.56 best=93.79@700 260621-20:44:21 (UTC+8)260621-20:44:23 (UTC+8)
62109_NoIBForce Phase2 epoch=800/1706 Val=93.38 Test=92.82 best=93.79@700 260621-20:44:19 (UTC+8)260621-20:44:20 (UTC+8)
62009_NoIBForce Phase2 epoch=700/1706 Val=93.79 Test=93.36 best=93.79@700 260621-20:44:17 (UTC+8)260621-20:44:18 (UTC+8)
61909_NoIBForce Phase2 epoch=600/1706 Val=93.20 Test=93.33 best=93.53@570 260621-20:44:14 (UTC+8)260621-20:44:16 (UTC+8)
61809_NoIBForce Phase2 epoch=500/1706 Val=92.97 Test=92.93 best=93.48@475 260621-20:44:12 (UTC+8)260621-20:44:14 (UTC+8)
61709_NoIBForce Phase2 epoch=400/1706 Val=93.00 Test=93.13 best=93.03@395 260621-20:44:11 (UTC+8)260621-20:44:12 (UTC+8)
61609_NoIBForce Phase2 epoch=300/1706 Val=92.67 Test=92.52 best=92.67@300 260621-20:44:08 (UTC+8)260621-20:44:10 (UTC+8)
61509_NoIBForce Phase2 epoch=200/1706 Val=91.78 Test=91.96 best=91.88@190 260621-20:44:06 (UTC+8)260621-20:44:08 (UTC+8)
61409_NoIBForce Phase2 epoch=100/1706 Val=89.48 Test=89.88 best=89.48@100 260621-20:44:04 (UTC+8)260621-20:44:05 (UTC+8)
61309_NoIBForce Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-20:44:02 (UTC+8)260621-20:44:04 (UTC+8)
61209_NoIBForce Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-20:44:01 (UTC+8)260621-20:44:02 (UTC+8)
61109_NoIBForce Phase1 完成:best=93.41@217 targets=19717 260621-20:43:58 (UTC+8)260621-20:43:59 (UTC+8)
61009_NoIBForce Phase1 epoch=2200/2256 best=93.41@217 260621-20:43:46 (UTC+8)260621-20:43:47 (UTC+8)
60909_NoIBForce Phase1 epoch=2100/2256 best=93.41@217 260621-20:43:25 (UTC+8)260621-20:43:26 (UTC+8)
60809_NoIBForce Phase1 epoch=2000/2256 best=93.41@217 260621-20:43:03 (UTC+8)260621-20:43:05 (UTC+8)
60709_NoIBForce Phase1 epoch=1900/2256 best=93.41@217 260621-20:42:40 (UTC+8)260621-20:42:44 (UTC+8)
60609_NoIBForce Phase1 epoch=1800/2256 best=93.41@217 260621-20:42:20 (UTC+8)260621-20:42:23 (UTC+8)
60509_NoIBForce Phase1 epoch=1700/2256 best=93.41@217 260621-20:41:59 (UTC+8)260621-20:42:00 (UTC+8)
60409_NoIBForce Phase1 epoch=1600/2256 best=93.41@217 260621-20:41:38 (UTC+8)260621-20:41:39 (UTC+8)
60309_NoIBForce Phase1 epoch=1500/2256 best=93.41@217 260621-20:41:18 (UTC+8)260621-20:41:20 (UTC+8)
60209_NoIBForce Phase1 epoch=1400/2256 best=93.41@217 260621-20:40:51 (UTC+8)260621-20:40:52 (UTC+8)
60109_NoIBForce Phase1 epoch=1300/2256 best=93.41@217 260621-20:40:25 (UTC+8)260621-20:40:26 (UTC+8)
60009_NoIBForce Phase1 epoch=1200/2256 best=93.41@217 260621-20:39:59 (UTC+8)260621-20:40:00 (UTC+8)
59909_NoIBForce Phase1 epoch=1000/2256 best=93.41@217 260621-20:39:01 (UTC+8)260621-20:39:03 (UTC+8)
59809_NoIBForce Phase1 epoch=900/2256 best=93.41@217 260621-20:38:34 (UTC+8)260621-20:38:37 (UTC+8)
59709_NoIBForce Phase1 epoch=800/2256 best=93.41@217 260621-20:38:08 (UTC+8)260621-20:38:09 (UTC+8)
59609_NoIBForce Phase1 epoch=700/2256 best=93.41@217 260621-20:37:41 (UTC+8)260621-20:37:43 (UTC+8)
59509_NoIBForce Phase1 epoch=600/2256 best=93.41@217 260621-20:37:14 (UTC+8)260621-20:37:16 (UTC+8)
59409_NoIBForce Phase1 epoch=500/2256 best=93.41@217 260621-20:36:48 (UTC+8)260621-20:36:49 (UTC+8)
59309_NoIBForce Phase1 epoch=400/2256 best=93.41@217 260621-20:36:22 (UTC+8)260621-20:36:23 (UTC+8)
59209_NoIBForce Phase1 epoch=300/2256 best=93.41@217 260621-20:35:54 (UTC+8)260621-20:35:55 (UTC+8)
59109_NoIBForce Phase1 epoch=200/2256 best=93.36@200 260621-20:35:27 (UTC+8)260621-20:35:29 (UTC+8)
59009_NoIBForce Phase1 epoch=100/2256 best=93.28@86 260621-20:35:01 (UTC+8)260621-20:35:02 (UTC+8)
58909_NoIBForce Phase1 epoch=1/2256 best=39.79@1 260621-20:34:35 (UTC+8)260621-20:34:36 (UTC+8)
58809_NoIBForce Phase1 启动:Three-force ablation: no bottleneck force 260621-20:34:34 (UTC+8)260621-20:34:35 (UTC+8)
58709_NoIBForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-20:34:29 (UTC+8)260621-20:34:29 (UTC+8)
58608_NoPredForce 完成:Val=90.24 Test=90.06 MLP=88.84 GNN=88.69 260621-20:34:23 (UTC+8)260621-20:34:25 (UTC+8)
58508_NoPredForce Phase2 完成:Val=90.24 Test=90.06 best_epoch=625 260621-20:34:22 (UTC+8)260621-20:34:24 (UTC+8)
58408_NoPredForce Phase2 epoch=1700/1706 Val=88.00 Test=88.95 best=90.24@625 260621-20:34:21 (UTC+8)260621-20:34:23 (UTC+8)
58308_NoPredForce Phase2 epoch=1600/1706 Val=88.54 Test=89.53 best=90.24@625 260621-20:34:19 (UTC+8)260621-20:34:21 (UTC+8)
58208_NoPredForce Phase2 epoch=1500/1706 Val=89.53 Test=89.81 best=90.24@625 260621-20:34:16 (UTC+8)260621-20:34:18 (UTC+8)
58108_NoPredForce Phase2 epoch=1400/1706 Val=88.54 Test=89.35 best=90.24@625 260621-20:34:14 (UTC+8)260621-20:34:16 (UTC+8)
58008_NoPredForce Phase2 epoch=1300/1706 Val=89.22 Test=89.66 best=90.24@625 260621-20:34:13 (UTC+8)260621-20:34:14 (UTC+8)
57908_NoPredForce Phase2 epoch=1200/1706 Val=84.96 Test=85.95 best=90.24@625 260621-20:34:10 (UTC+8)260621-20:34:12 (UTC+8)
57808_NoPredForce Phase2 epoch=1100/1706 Val=89.12 Test=89.73 best=90.24@625 260621-20:34:09 (UTC+8)260621-20:34:10 (UTC+8)
57708_NoPredForce Phase2 epoch=1000/1706 Val=90.06 Test=90.04 best=90.24@625 260621-20:34:07 (UTC+8)260621-20:34:08 (UTC+8)
57608_NoPredForce Phase2 epoch=900/1706 Val=88.97 Test=89.81 best=90.24@625 260621-20:34:05 (UTC+8)260621-20:34:06 (UTC+8)
57508_NoPredForce Phase2 epoch=800/1706 Val=89.73 Test=90.24 best=90.24@625 260621-20:34:03 (UTC+8)260621-20:34:04 (UTC+8)
57408_NoPredForce Phase2 epoch=700/1706 Val=88.00 Test=87.98 best=90.24@625 260621-20:34:00 (UTC+8)260621-20:34:02 (UTC+8)
57308_NoPredForce Phase2 epoch=600/1706 Val=90.11 Test=90.14 best=90.16@595 260621-20:33:58 (UTC+8)260621-20:33:59 (UTC+8)
57208_NoPredForce Phase2 epoch=500/1706 Val=89.96 Test=90.39 best=90.08@435 260621-20:33:56 (UTC+8)260621-20:33:57 (UTC+8)
57108_NoPredForce Phase2 epoch=400/1706 Val=89.53 Test=89.40 best=89.93@345 260621-20:33:54 (UTC+8)260621-20:33:55 (UTC+8)
57008_NoPredForce Phase2 epoch=300/1706 Val=89.55 Test=89.55 best=89.55@300 260621-20:33:52 (UTC+8)260621-20:33:53 (UTC+8)
56908_NoPredForce Phase2 epoch=200/1706 Val=88.46 Test=88.82 best=88.84@150 260621-20:33:49 (UTC+8)260621-20:33:51 (UTC+8)
56808_NoPredForce Phase2 epoch=100/1706 Val=83.44 Test=84.36 best=87.70@75 260621-20:33:47 (UTC+8)260621-20:33:49 (UTC+8)
56708_NoPredForce Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-20:33:45 (UTC+8)260621-20:33:46 (UTC+8)
56608_NoPredForce Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-20:33:43 (UTC+8)260621-20:33:45 (UTC+8)
56508_NoPredForce Phase1 完成:best=43.49@19 targets=19717 260621-20:33:40 (UTC+8)260621-20:33:42 (UTC+8)
56408_NoPredForce Phase1 epoch=2200/2256 best=43.49@19 260621-20:33:29 (UTC+8)260621-20:33:30 (UTC+8)
56308_NoPredForce Phase1 epoch=2100/2256 best=43.49@19 260621-20:33:08 (UTC+8)260621-20:33:09 (UTC+8)
56208_NoPredForce Phase1 epoch=2000/2256 best=43.49@19 260621-20:32:48 (UTC+8)260621-20:32:49 (UTC+8)
56108_NoPredForce Phase1 epoch=1900/2256 best=43.49@19 260621-20:32:27 (UTC+8)260621-20:32:28 (UTC+8)
56008_NoPredForce Phase1 epoch=1800/2256 best=43.49@19 260621-20:32:06 (UTC+8)260621-20:32:08 (UTC+8)
55908_NoPredForce Phase1 epoch=1700/2256 best=43.49@19 260621-20:31:46 (UTC+8)260621-20:31:47 (UTC+8)
55808_NoPredForce Phase1 epoch=1600/2256 best=43.49@19 260621-20:31:24 (UTC+8)260621-20:31:26 (UTC+8)
55708_NoPredForce Phase1 epoch=1500/2256 best=43.49@19 260621-20:31:04 (UTC+8)260621-20:31:05 (UTC+8)
55608_NoPredForce Phase1 epoch=1400/2256 best=43.49@19 260621-20:30:37 (UTC+8)260621-20:30:38 (UTC+8)
55508_NoPredForce Phase1 epoch=1300/2256 best=43.49@19 260621-20:30:11 (UTC+8)260621-20:30:12 (UTC+8)
55408_NoPredForce Phase1 epoch=1200/2256 best=43.49@19 260621-20:29:43 (UTC+8)260621-20:29:46 (UTC+8)
55308_NoPredForce Phase1 epoch=1100/2256 best=43.49@19 260621-20:29:17 (UTC+8)260621-20:29:18 (UTC+8)
55208_NoPredForce Phase1 epoch=1000/2256 best=43.49@19 260621-20:28:50 (UTC+8)260621-20:28:53 (UTC+8)
55108_NoPredForce Phase1 epoch=900/2256 best=43.49@19 260621-20:28:23 (UTC+8)260621-20:28:25 (UTC+8)
55008_NoPredForce Phase1 epoch=800/2256 best=43.49@19 260621-20:27:57 (UTC+8)260621-20:27:58 (UTC+8)
54908_NoPredForce Phase1 epoch=700/2256 best=43.49@19 260621-20:27:29 (UTC+8)260621-20:27:31 (UTC+8)
54808_NoPredForce Phase1 epoch=600/2256 best=43.49@19 260621-20:27:03 (UTC+8)260621-20:27:04 (UTC+8)
54708_NoPredForce Phase1 epoch=500/2256 best=43.49@19 260621-20:26:35 (UTC+8)260621-20:26:37 (UTC+8)
54608_NoPredForce Phase1 epoch=400/2256 best=43.49@19 260621-20:26:11 (UTC+8)260621-20:26:12 (UTC+8)
54508_NoPredForce Phase1 epoch=300/2256 best=43.49@19 260621-20:25:44 (UTC+8)260621-20:25:45 (UTC+8)
54408_NoPredForce Phase1 epoch=200/2256 best=43.49@19 260621-20:25:16 (UTC+8)260621-20:25:18 (UTC+8)
54308_NoPredForce Phase1 epoch=100/2256 best=43.49@19 260621-20:24:50 (UTC+8)260621-20:24:51 (UTC+8)
54208_NoPredForce Phase1 epoch=1/2256 best=39.11@1 260621-20:24:25 (UTC+8)260621-20:24:26 (UTC+8)
54108_NoPredForce Phase1 启动:Three-force ablation: no prediction force 260621-20:24:23 (UTC+8)260621-20:24:24 (UTC+8)
54008_NoPredForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-20:24:18 (UTC+8)260621-20:24:19 (UTC+8)
53907_StudentTargetMismatch 完成:Val=93.71 Test=93.41 MLP=93.08 GNN=90.24 260621-20:24:13 (UTC+8)260621-20:24:14 (UTC+8)
53807_StudentTargetMismatch Phase2 完成:Val=93.71 Test=93.41 best_epoch=525 260621-20:24:12 (UTC+8)260621-20:24:13 (UTC+8)
53707_StudentTargetMismatch Phase2 epoch=1700/1706 Val=92.95 Test=92.93 best=93.71@525 260621-20:24:09 (UTC+8)260621-20:24:12 (UTC+8)
53607_StudentTargetMismatch Phase2 epoch=1600/1706 Val=92.75 Test=92.47 best=93.71@525 260621-20:24:07 (UTC+8)260621-20:24:08 (UTC+8)
53507_StudentTargetMismatch Phase2 epoch=1500/1706 Val=93.30 Test=92.88 best=93.71@525 260621-20:24:04 (UTC+8)260621-20:24:06 (UTC+8)
53407_StudentTargetMismatch Phase2 epoch=1400/1706 Val=93.13 Test=93.26 best=93.71@525 260621-20:24:02 (UTC+8)260621-20:24:04 (UTC+8)
53307_StudentTargetMismatch Phase2 epoch=1300/1706 Val=93.38 Test=93.20 best=93.71@525 260621-20:24:00 (UTC+8)260621-20:24:02 (UTC+8)
53207_StudentTargetMismatch Phase2 epoch=1200/1706 Val=93.13 Test=93.05 best=93.71@525 260621-20:23:58 (UTC+8)260621-20:23:59 (UTC+8)
53107_StudentTargetMismatch Phase2 epoch=1100/1706 Val=93.13 Test=93.23 best=93.71@525 260621-20:23:57 (UTC+8)260621-20:23:58 (UTC+8)
53007_StudentTargetMismatch Phase2 epoch=1000/1706 Val=93.15 Test=93.00 best=93.71@525 260621-20:23:54 (UTC+8)260621-20:23:56 (UTC+8)
52907_StudentTargetMismatch Phase2 epoch=800/1706 Val=93.15 Test=93.64 best=93.71@525 260621-20:23:46 (UTC+8)260621-20:23:47 (UTC+8)
52807_StudentTargetMismatch Phase2 epoch=700/1706 Val=93.46 Test=93.46 best=93.71@525 260621-20:23:44 (UTC+8)260621-20:23:45 (UTC+8)
52707_StudentTargetMismatch Phase2 epoch=500/1706 Val=92.80 Test=92.93 best=93.58@470 260621-20:23:34 (UTC+8)260621-20:23:36 (UTC+8)
52607_StudentTargetMismatch Phase2 epoch=400/1706 Val=92.82 Test=92.70 best=93.30@395 260621-20:23:32 (UTC+8)260621-20:23:34 (UTC+8)
52507_StudentTargetMismatch Phase2 epoch=300/1706 Val=92.59 Test=92.62 best=92.80@285 260621-20:23:30 (UTC+8)260621-20:23:32 (UTC+8)
52407_StudentTargetMismatch Phase2 epoch=200/1706 Val=91.66 Test=91.71 best=91.81@190 260621-20:23:28 (UTC+8)260621-20:23:30 (UTC+8)
52307_StudentTargetMismatch Phase2 epoch=100/1706 Val=89.55 Test=90.16 best=89.55@100 260621-20:23:26 (UTC+8)260621-20:23:28 (UTC+8)
52207_StudentTargetMismatch Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-20:23:24 (UTC+8)260621-20:23:26 (UTC+8)
52107_StudentTargetMismatch Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-20:23:24 (UTC+8)260621-20:23:25 (UTC+8)
52007_StudentTargetMismatch Phase1 完成:best=93.46@308 targets=19717 260621-20:23:21 (UTC+8)260621-20:23:22 (UTC+8)
51907_StudentTargetMismatch Phase1 epoch=2100/2256 best=93.46@308 260621-20:22:43 (UTC+8)260621-20:22:44 (UTC+8)
51807_StudentTargetMismatch Phase1 epoch=2000/2256 best=93.46@308 260621-20:22:22 (UTC+8)260621-20:22:23 (UTC+8)
51707_StudentTargetMismatch Phase1 epoch=1900/2256 best=93.46@308 260621-20:22:01 (UTC+8)260621-20:22:03 (UTC+8)
51607_StudentTargetMismatch Phase1 epoch=1800/2256 best=93.46@308 260621-20:21:40 (UTC+8)260621-20:21:41 (UTC+8)
51507_StudentTargetMismatch Phase1 epoch=1700/2256 best=93.46@308 260621-20:21:17 (UTC+8)260621-20:21:19 (UTC+8)
51407_StudentTargetMismatch Phase1 epoch=1600/2256 best=93.46@308 260621-20:20:57 (UTC+8)260621-20:20:58 (UTC+8)
51307_StudentTargetMismatch Phase1 epoch=1500/2256 best=93.46@308 260621-20:20:37 (UTC+8)260621-20:20:39 (UTC+8)
51207_StudentTargetMismatch Phase1 epoch=1400/2256 best=93.46@308 260621-20:20:09 (UTC+8)260621-20:20:11 (UTC+8)
51107_StudentTargetMismatch Phase1 epoch=1300/2256 best=93.46@308 260621-20:19:43 (UTC+8)260621-20:19:44 (UTC+8)
51007_StudentTargetMismatch Phase1 epoch=1200/2256 best=93.46@308 260621-20:19:16 (UTC+8)260621-20:19:18 (UTC+8)
50907_StudentTargetMismatch Phase1 epoch=1100/2256 best=93.46@308 260621-20:18:49 (UTC+8)260621-20:18:50 (UTC+8)
50807_StudentTargetMismatch Phase1 epoch=1000/2256 best=93.46@308 260621-20:18:22 (UTC+8)260621-20:18:24 (UTC+8)
50707_StudentTargetMismatch Phase1 epoch=900/2256 best=93.46@308 260621-20:17:57 (UTC+8)260621-20:17:58 (UTC+8)
50607_StudentTargetMismatch Phase1 epoch=800/2256 best=93.46@308 260621-20:17:29 (UTC+8)260621-20:17:31 (UTC+8)
50507_StudentTargetMismatch Phase1 epoch=700/2256 best=93.46@308 260621-20:17:04 (UTC+8)260621-20:17:04 (UTC+8)
50407_StudentTargetMismatch Phase1 epoch=600/2256 best=93.46@308 260621-20:16:36 (UTC+8)260621-20:16:37 (UTC+8)
50307_StudentTargetMismatch Phase1 epoch=500/2256 best=93.46@308 260621-20:16:09 (UTC+8)260621-20:16:10 (UTC+8)
50207_StudentTargetMismatch Phase1 epoch=400/2256 best=93.46@308 260621-20:15:43 (UTC+8)260621-20:15:44 (UTC+8)
50107_StudentTargetMismatch Phase1 epoch=300/2256 best=93.41@248 260621-20:15:15 (UTC+8)260621-20:15:17 (UTC+8)
50007_StudentTargetMismatch Phase1 epoch=200/2256 best=93.30@118 260621-20:14:50 (UTC+8)260621-20:14:50 (UTC+8)
49907_StudentTargetMismatch Phase1 epoch=100/2256 best=93.18@92 260621-20:14:22 (UTC+8)260621-20:14:23 (UTC+8)
49807_StudentTargetMismatch Phase1 epoch=1/2256 best=39.79@1 260621-20:13:56 (UTC+8)260621-20:13:57 (UTC+8)
49707_StudentTargetMismatch Phase1 启动:Student-target mismatch 260621-20:13:55 (UTC+8)260621-20:13:56 (UTC+8)
49607_StudentTargetMismatch 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-20:13:49 (UTC+8)260621-20:13:50 (UTC+8)
49506_NoConditionalTopology 完成:Val=93.28 Test=92.88 MLP=91.71 GNN=92.11 260621-20:13:46 (UTC+8)260621-20:13:46 (UTC+8)
49406_NoConditionalTopology Phase2 完成:Val=93.28 Test=92.88 best_epoch=1465 260621-20:13:45 (UTC+8)260621-20:13:45 (UTC+8)
49306_NoConditionalTopology Phase2 epoch=1700/1706 Val=93.03 Test=92.88 best=93.28@1465 260621-20:13:44 (UTC+8)260621-20:13:44 (UTC+8)
49206_NoConditionalTopology Phase2 epoch=1600/1706 Val=92.49 Test=92.72 best=93.28@1465 260621-20:13:42 (UTC+8)260621-20:13:42 (UTC+8)
49106_NoConditionalTopology Phase2 epoch=1500/1706 Val=92.90 Test=92.90 best=93.28@1465 260621-20:13:39 (UTC+8)260621-20:13:40 (UTC+8)
49006_NoConditionalTopology Phase2 epoch=1400/1706 Val=92.97 Test=93.20 best=93.20@1295 260621-20:13:36 (UTC+8)260621-20:13:38 (UTC+8)
48906_NoConditionalTopology Phase2 epoch=1300/1706 Val=93.13 Test=92.98 best=93.20@1295 260621-20:13:34 (UTC+8)260621-20:13:36 (UTC+8)
48806_NoConditionalTopology Phase2 epoch=1200/1706 Val=92.19 Test=92.67 best=93.13@1005 260621-20:13:31 (UTC+8)260621-20:13:34 (UTC+8)
48706_NoConditionalTopology Phase2 epoch=1100/1706 Val=92.49 Test=92.44 best=93.13@1005 260621-20:13:30 (UTC+8)260621-20:13:31 (UTC+8)
48606_NoConditionalTopology Phase2 epoch=1000/1706 Val=92.80 Test=92.49 best=93.00@975 260621-20:13:28 (UTC+8)260621-20:13:30 (UTC+8)
48506_NoConditionalTopology Phase2 epoch=900/1706 Val=92.32 Test=92.17 best=92.85@740 260621-20:13:26 (UTC+8)260621-20:13:27 (UTC+8)
48406_NoConditionalTopology Phase2 epoch=800/1706 Val=91.86 Test=92.22 best=92.85@740 260621-20:13:24 (UTC+8)260621-20:13:26 (UTC+8)
48306_NoConditionalTopology Phase2 epoch=700/1706 Val=92.19 Test=92.09 best=92.54@590 260621-20:13:22 (UTC+8)260621-20:13:23 (UTC+8)
48206_NoConditionalTopology Phase2 epoch=600/1706 Val=92.37 Test=92.37 best=92.54@590 260621-20:13:20 (UTC+8)260621-20:13:21 (UTC+8)
48106_NoConditionalTopology Phase2 epoch=500/1706 Val=91.88 Test=91.86 best=92.16@495 260621-20:13:18 (UTC+8)260621-20:13:19 (UTC+8)
48006_NoConditionalTopology Phase2 epoch=400/1706 Val=91.76 Test=91.40 best=91.76@395 260621-20:13:16 (UTC+8)260621-20:13:17 (UTC+8)
47906_NoConditionalTopology Phase2 epoch=300/1706 Val=91.17 Test=91.08 best=91.17@300 260621-20:13:14 (UTC+8)260621-20:13:15 (UTC+8)
47806_NoConditionalTopology Phase2 epoch=200/1706 Val=89.98 Test=90.26 best=90.06@185 260621-20:13:12 (UTC+8)260621-20:13:13 (UTC+8)
47706_NoConditionalTopology Phase2 epoch=100/1706 Val=89.02 Test=89.38 best=89.02@100 260621-20:13:10 (UTC+8)260621-20:13:11 (UTC+8)
47606_NoConditionalTopology Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-20:13:08 (UTC+8)260621-20:13:09 (UTC+8)
47506_NoConditionalTopology Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-20:13:07 (UTC+8)260621-20:13:08 (UTC+8)
47406_NoConditionalTopology Phase1 完成:best=93.25@241 targets=19717 260621-20:13:05 (UTC+8)260621-20:13:06 (UTC+8)
47306_NoConditionalTopology Phase1 epoch=2200/2256 best=93.25@241 260621-20:12:54 (UTC+8)260621-20:12:55 (UTC+8)
47206_NoConditionalTopology Phase1 epoch=2100/2256 best=93.25@241 260621-20:12:37 (UTC+8)260621-20:12:38 (UTC+8)
47106_NoConditionalTopology Phase1 epoch=2000/2256 best=93.25@241 260621-20:12:19 (UTC+8)260621-20:12:20 (UTC+8)
47006_NoConditionalTopology Phase1 epoch=1900/2256 best=93.25@241 260621-20:12:02 (UTC+8)260621-20:12:02 (UTC+8)
46906_NoConditionalTopology Phase1 epoch=1800/2256 best=93.25@241 260621-20:11:43 (UTC+8)260621-20:11:45 (UTC+8)
46806_NoConditionalTopology Phase1 epoch=1700/2256 best=93.25@241 260621-20:11:26 (UTC+8)260621-20:11:27 (UTC+8)
46706_NoConditionalTopology Phase1 epoch=1600/2256 best=93.25@241 260621-20:11:08 (UTC+8)260621-20:11:09 (UTC+8)
46606_NoConditionalTopology Phase1 epoch=1500/2256 best=93.25@241 260621-20:10:51 (UTC+8)260621-20:10:52 (UTC+8)
46506_NoConditionalTopology Phase1 epoch=1400/2256 best=93.25@241 260621-20:10:28 (UTC+8)260621-20:10:30 (UTC+8)
46406_NoConditionalTopology Phase1 epoch=1300/2256 best=93.25@241 260621-20:10:05 (UTC+8)260621-20:10:06 (UTC+8)
46306_NoConditionalTopology Phase1 epoch=1200/2256 best=93.25@241 260621-20:09:43 (UTC+8)260621-20:09:44 (UTC+8)
46206_NoConditionalTopology Phase1 epoch=1100/2256 best=93.25@241 260621-20:09:19 (UTC+8)260621-20:09:21 (UTC+8)
46106_NoConditionalTopology Phase1 epoch=900/2256 best=93.25@241 260621-20:08:30 (UTC+8)260621-20:08:32 (UTC+8)
46006_NoConditionalTopology Phase1 epoch=800/2256 best=93.25@241 260621-20:08:07 (UTC+8)260621-20:08:09 (UTC+8)
45906_NoConditionalTopology Phase1 epoch=700/2256 best=93.25@241 260621-20:07:45 (UTC+8)260621-20:07:46 (UTC+8)
45806_NoConditionalTopology Phase1 epoch=600/2256 best=93.25@241 260621-20:07:23 (UTC+8)260621-20:07:25 (UTC+8)
45706_NoConditionalTopology Phase1 epoch=500/2256 best=93.25@241 260621-20:07:00 (UTC+8)260621-20:07:02 (UTC+8)
45606_NoConditionalTopology Phase1 epoch=400/2256 best=93.25@241 260621-20:06:38 (UTC+8)260621-20:06:39 (UTC+8)
45506_NoConditionalTopology Phase1 epoch=300/2256 best=93.25@241 260621-20:06:15 (UTC+8)260621-20:06:16 (UTC+8)
45406_NoConditionalTopology Phase1 epoch=200/2256 best=93.15@121 260621-20:05:51 (UTC+8)260621-20:05:53 (UTC+8)
45306_NoConditionalTopology Phase1 epoch=1/2256 best=71.01@1 260621-20:05:03 (UTC+8)260621-20:05:04 (UTC+8)
45206_NoConditionalTopology Phase1 启动:No conditional topology 260621-20:05:02 (UTC+8)260621-20:05:03 (UTC+8)
45106_NoConditionalTopology 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-20:04:57 (UTC+8)260621-20:04:58 (UTC+8)
45005_NoVIB 完成:Val=93.69 Test=93.43 MLP=92.49 GNN=91.73 260621-20:04:52 (UTC+8)260621-20:04:53 (UTC+8)
44905_NoVIB Phase2 完成:Val=93.69 Test=93.43 best_epoch=525 260621-20:04:51 (UTC+8)260621-20:04:52 (UTC+8)
44805_NoVIB Phase2 epoch=1700/1706 Val=92.85 Test=93.10 best=93.69@525 260621-20:04:51 (UTC+8)260621-20:04:51 (UTC+8)
44705_NoVIB Phase2 epoch=1600/1706 Val=93.13 Test=93.20 best=93.69@525 260621-20:04:49 (UTC+8)260621-20:04:49 (UTC+8)
44605_NoVIB Phase2 epoch=1500/1706 Val=93.15 Test=93.26 best=93.69@525 260621-20:04:47 (UTC+8)260621-20:04:48 (UTC+8)
44505_NoVIB Phase2 epoch=1400/1706 Val=93.05 Test=93.28 best=93.69@525 260621-20:04:45 (UTC+8)260621-20:04:46 (UTC+8)
44405_NoVIB Phase2 epoch=1300/1706 Val=93.38 Test=93.20 best=93.69@525 260621-20:04:42 (UTC+8)260621-20:04:44 (UTC+8)
44305_NoVIB Phase2 epoch=1200/1706 Val=93.13 Test=92.90 best=93.69@525 260621-20:04:40 (UTC+8)260621-20:04:41 (UTC+8)
44205_NoVIB Phase2 epoch=1100/1706 Val=93.18 Test=93.20 best=93.69@525 260621-20:04:37 (UTC+8)260621-20:04:39 (UTC+8)
44105_NoVIB Phase2 epoch=1000/1706 Val=93.13 Test=92.95 best=93.69@525 260621-20:04:35 (UTC+8)260621-20:04:37 (UTC+8)
44005_NoVIB Phase2 epoch=900/1706 Val=93.43 Test=93.15 best=93.69@525 260621-20:04:33 (UTC+8)260621-20:04:35 (UTC+8)
43905_NoVIB Phase2 epoch=800/1706 Val=93.25 Test=93.43 best=93.69@525 260621-20:04:31 (UTC+8)260621-20:04:33 (UTC+8)
43805_NoVIB Phase2 epoch=700/1706 Val=92.95 Test=93.53 best=93.69@525 260621-20:04:29 (UTC+8)260621-20:04:31 (UTC+8)
43705_NoVIB Phase2 epoch=600/1706 Val=93.41 Test=93.15 best=93.69@525 260621-20:04:27 (UTC+8)260621-20:04:28 (UTC+8)
43605_NoVIB Phase2 epoch=500/1706 Val=93.30 Test=93.15 best=93.30@500 260621-20:04:25 (UTC+8)260621-20:04:26 (UTC+8)
43505_NoVIB Phase2 epoch=400/1706 Val=92.77 Test=93.18 best=93.15@395 260621-20:04:23 (UTC+8)260621-20:04:24 (UTC+8)
43405_NoVIB Phase2 epoch=300/1706 Val=91.81 Test=91.76 best=92.42@295 260621-20:04:21 (UTC+8)260621-20:04:22 (UTC+8)
43305_NoVIB Phase2 epoch=200/1706 Val=91.78 Test=91.51 best=91.78@200 260621-20:04:19 (UTC+8)260621-20:04:20 (UTC+8)
43205_NoVIB Phase2 epoch=100/1706 Val=89.22 Test=89.83 best=89.22@100 260621-20:04:17 (UTC+8)260621-20:04:18 (UTC+8)
43105_NoVIB Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-20:04:15 (UTC+8)260621-20:04:15 (UTC+8)
43005_NoVIB Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-20:04:14 (UTC+8)260621-20:04:15 (UTC+8)
42905_NoVIB Phase1 完成:best=93.41@192 targets=19717 260621-20:04:12 (UTC+8)260621-20:04:12 (UTC+8)
42805_NoVIB Phase1 epoch=2200/2256 best=93.41@192 260621-20:03:59 (UTC+8)260621-20:04:01 (UTC+8)
42705_NoVIB Phase1 epoch=2100/2256 best=93.41@192 260621-20:03:38 (UTC+8)260621-20:03:39 (UTC+8)
42605_NoVIB Phase1 epoch=2000/2256 best=93.41@192 260621-20:03:17 (UTC+8)260621-20:03:18 (UTC+8)
42505_NoVIB Phase1 epoch=1800/2256 best=93.41@192 260621-20:02:31 (UTC+8)260621-20:02:32 (UTC+8)
42405_NoVIB Phase1 epoch=1700/2256 best=93.41@192 260621-20:02:09 (UTC+8)260621-20:02:10 (UTC+8)
42305_NoVIB Phase1 epoch=1600/2256 best=93.41@192 260621-20:01:47 (UTC+8)260621-20:01:49 (UTC+8)
42205_NoVIB Phase1 epoch=1500/2256 best=93.41@192 260621-20:01:28 (UTC+8)260621-20:01:29 (UTC+8)
42105_NoVIB Phase1 epoch=1400/2256 best=93.41@192 260621-20:01:00 (UTC+8)260621-20:01:02 (UTC+8)
42005_NoVIB Phase1 epoch=1300/2256 best=93.41@192 260621-20:00:34 (UTC+8)260621-20:00:35 (UTC+8)
41905_NoVIB Phase1 epoch=1200/2256 best=93.41@192 260621-20:00:08 (UTC+8)260621-20:00:09 (UTC+8)
41805_NoVIB Phase1 epoch=1100/2256 best=93.41@192 260621-19:59:40 (UTC+8)260621-19:59:42 (UTC+8)
41705_NoVIB Phase1 epoch=1000/2256 best=93.41@192 260621-19:59:14 (UTC+8)260621-19:59:16 (UTC+8)
41605_NoVIB Phase1 epoch=900/2256 best=93.41@192 260621-19:58:49 (UTC+8)260621-19:58:50 (UTC+8)
41505_NoVIB Phase1 epoch=800/2256 best=93.41@192 260621-19:58:21 (UTC+8)260621-19:58:22 (UTC+8)
41405_NoVIB Phase1 epoch=700/2256 best=93.41@192 260621-19:57:54 (UTC+8)260621-19:57:56 (UTC+8)
41305_NoVIB Phase1 epoch=600/2256 best=93.41@192 260621-19:56:30 (UTC+8)260621-19:57:29 (UTC+8)
41205_NoVIB Phase1 epoch=500/2256 best=93.41@192 260621-19:56:04 (UTC+8)260621-19:57:01 (UTC+8)
41105_NoVIB Phase1 epoch=400/2256 best=93.41@192 260621-19:55:38 (UTC+8)260621-19:56:35 (UTC+8)
41005_NoVIB Phase1 epoch=300/2256 best=93.41@192 260621-19:55:12 (UTC+8)260621-19:56:08 (UTC+8)
40905_NoVIB Phase1 epoch=200/2256 best=93.41@192 260621-19:54:47 (UTC+8)260621-19:55:42 (UTC+8)
40805_NoVIB Phase1 epoch=100/2256 best=93.28@86 260621-19:54:21 (UTC+8)260621-19:55:14 (UTC+8)
40705_NoVIB Phase1 epoch=1/2256 best=39.79@1 260621-19:53:56 (UTC+8)260621-19:54:48 (UTC+8)
40605_NoVIB Phase1 启动:No VIB bottleneck 260621-19:53:55 (UTC+8)260621-19:54:47 (UTC+8)
40505_NoVIB 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:53:50 (UTC+8)260621-19:54:42 (UTC+8)
40404_NoSemanticGlobalInvariance 完成:Val=93.84 Test=93.59 MLP=93.13 GNN=92.70 260621-19:53:45 (UTC+8)260621-19:54:38 (UTC+8)
40304_NoSemanticGlobalInvariance Phase2 完成:Val=93.84 Test=93.59 best_epoch=1075 260621-19:53:44 (UTC+8)260621-19:54:36 (UTC+8)
40204_NoSemanticGlobalInvariance Phase2 epoch=1700/1706 Val=93.28 Test=93.26 best=93.84@1075 260621-19:53:43 (UTC+8)260621-19:54:35 (UTC+8)
40104_NoSemanticGlobalInvariance Phase2 epoch=1600/1706 Val=93.00 Test=93.56 best=93.84@1075 260621-19:53:41 (UTC+8)260621-19:54:33 (UTC+8)
40004_NoSemanticGlobalInvariance Phase2 epoch=1500/1706 Val=93.15 Test=93.89 best=93.84@1075 260621-19:53:39 (UTC+8)260621-19:54:31 (UTC+8)
39904_NoSemanticGlobalInvariance Phase2 epoch=1400/1706 Val=93.58 Test=94.09 best=93.84@1075 260621-19:53:37 (UTC+8)260621-19:54:29 (UTC+8)
39804_NoSemanticGlobalInvariance Phase2 epoch=1300/1706 Val=93.43 Test=93.51 best=93.84@1075 260621-19:53:35 (UTC+8)260621-19:54:27 (UTC+8)
39704_NoSemanticGlobalInvariance Phase2 epoch=1200/1706 Val=93.51 Test=93.59 best=93.84@1075 260621-19:53:33 (UTC+8)260621-19:54:24 (UTC+8)
39604_NoSemanticGlobalInvariance Phase2 epoch=1100/1706 Val=93.61 Test=93.48 best=93.84@1075 260621-19:53:31 (UTC+8)260621-19:54:22 (UTC+8)
39504_NoSemanticGlobalInvariance Phase2 epoch=1000/1706 Val=93.63 Test=93.64 best=93.81@985 260621-19:53:29 (UTC+8)260621-19:54:20 (UTC+8)
39404_NoSemanticGlobalInvariance Phase2 epoch=900/1706 Val=93.25 Test=93.48 best=93.71@580 260621-19:53:26 (UTC+8)260621-19:54:18 (UTC+8)
39304_NoSemanticGlobalInvariance Phase2 epoch=800/1706 Val=93.56 Test=93.71 best=93.71@580 260621-19:53:24 (UTC+8)260621-19:54:15 (UTC+8)
39204_NoSemanticGlobalInvariance Phase2 epoch=700/1706 Val=93.43 Test=93.86 best=93.71@580 260621-19:53:22 (UTC+8)260621-19:54:13 (UTC+8)
39104_NoSemanticGlobalInvariance Phase2 epoch=600/1706 Val=93.56 Test=93.41 best=93.71@580 260621-19:53:20 (UTC+8)260621-19:54:11 (UTC+8)
39004_NoSemanticGlobalInvariance Phase2 epoch=500/1706 Val=93.43 Test=92.93 best=93.48@410 260621-19:53:18 (UTC+8)260621-19:54:09 (UTC+8)
38904_NoSemanticGlobalInvariance Phase2 epoch=400/1706 Val=92.62 Test=92.14 best=92.90@380 260621-19:53:16 (UTC+8)260621-19:54:07 (UTC+8)
38804_NoSemanticGlobalInvariance Phase2 epoch=300/1706 Val=92.59 Test=92.14 best=92.75@285 260621-19:53:13 (UTC+8)260621-19:54:04 (UTC+8)
38704_NoSemanticGlobalInvariance Phase2 epoch=200/1706 Val=91.33 Test=91.18 best=91.45@195 260621-19:53:11 (UTC+8)260621-19:54:02 (UTC+8)
38604_NoSemanticGlobalInvariance Phase2 epoch=100/1706 Val=89.42 Test=89.63 best=89.42@100 260621-19:53:10 (UTC+8)260621-19:54:00 (UTC+8)
38504_NoSemanticGlobalInvariance Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-19:53:07 (UTC+8)260621-19:53:58 (UTC+8)
38404_NoSemanticGlobalInvariance Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-19:53:06 (UTC+8)260621-19:53:57 (UTC+8)
38304_NoSemanticGlobalInvariance Phase1 完成:best=93.20@272 targets=19717 260621-19:53:04 (UTC+8)260621-19:53:54 (UTC+8)
38204_NoSemanticGlobalInvariance Phase1 epoch=2200/2256 best=93.20@272 260621-19:52:53 (UTC+8)260621-19:53:42 (UTC+8)
38104_NoSemanticGlobalInvariance Phase1 epoch=2100/2256 best=93.20@272 260621-19:52:32 (UTC+8)260621-19:53:21 (UTC+8)
38004_NoSemanticGlobalInvariance Phase1 epoch=2000/2256 best=93.20@272 260621-19:52:12 (UTC+8)260621-19:53:00 (UTC+8)
37904_NoSemanticGlobalInvariance Phase1 epoch=1900/2256 best=93.20@272 260621-19:51:52 (UTC+8)260621-19:52:39 (UTC+8)
37804_NoSemanticGlobalInvariance Phase1 epoch=1800/2256 best=93.20@272 260621-19:51:32 (UTC+8)260621-19:52:18 (UTC+8)
37704_NoSemanticGlobalInvariance Phase1 epoch=1700/2256 best=93.20@272 260621-19:51:11 (UTC+8)260621-19:51:56 (UTC+8)
37604_NoSemanticGlobalInvariance Phase1 epoch=1600/2256 best=93.20@272 260621-19:50:51 (UTC+8)260621-19:51:35 (UTC+8)
37504_NoSemanticGlobalInvariance Phase1 epoch=1500/2256 best=93.20@272 260621-19:50:31 (UTC+8)260621-19:51:16 (UTC+8)
37404_NoSemanticGlobalInvariance Phase1 epoch=1400/2256 best=93.20@272 260621-19:50:05 (UTC+8)260621-19:50:48 (UTC+8)
37304_NoSemanticGlobalInvariance Phase1 epoch=1300/2256 best=93.20@272 260621-19:49:39 (UTC+8)260621-19:50:21 (UTC+8)
37204_NoSemanticGlobalInvariance Phase1 epoch=1200/2256 best=93.20@272 260621-19:49:14 (UTC+8)260621-19:49:55 (UTC+8)
37104_NoSemanticGlobalInvariance Phase1 epoch=1100/2256 best=93.20@272 260621-19:48:47 (UTC+8)260621-19:49:27 (UTC+8)
37004_NoSemanticGlobalInvariance Phase1 epoch=1000/2256 best=93.20@272 260621-19:48:22 (UTC+8)260621-19:49:01 (UTC+8)
36904_NoSemanticGlobalInvariance Phase1 epoch=900/2256 best=93.20@272 260621-19:47:57 (UTC+8)260621-19:48:35 (UTC+8)
36804_NoSemanticGlobalInvariance Phase1 epoch=800/2256 best=93.20@272 260621-19:47:31 (UTC+8)260621-19:48:07 (UTC+8)
36704_NoSemanticGlobalInvariance Phase1 epoch=700/2256 best=93.20@272 260621-19:47:05 (UTC+8)260621-19:47:41 (UTC+8)
36604_NoSemanticGlobalInvariance Phase1 epoch=600/2256 best=93.20@272 260621-19:46:39 (UTC+8)260621-19:47:14 (UTC+8)
36504_NoSemanticGlobalInvariance Phase1 epoch=500/2256 best=93.20@272 260621-19:46:13 (UTC+8)260621-19:46:46 (UTC+8)
36404_NoSemanticGlobalInvariance Phase1 epoch=400/2256 best=93.20@272 260621-19:45:48 (UTC+8)260621-19:46:20 (UTC+8)
36304_NoSemanticGlobalInvariance Phase1 epoch=300/2256 best=93.20@272 260621-19:45:21 (UTC+8)260621-19:45:53 (UTC+8)
36204_NoSemanticGlobalInvariance Phase1 epoch=200/2256 best=93.08@173 260621-19:44:56 (UTC+8)260621-19:45:26 (UTC+8)
36104_NoSemanticGlobalInvariance Phase1 epoch=100/2256 best=93.05@84 260621-19:44:30 (UTC+8)260621-19:44:59 (UTC+8)
36004_NoSemanticGlobalInvariance Phase1 epoch=1/2256 best=39.84@1 260621-19:44:06 (UTC+8)260621-19:44:33 (UTC+8)
35904_NoSemanticGlobalInvariance Phase1 启动:No semantic global invariance 260621-19:44:04 (UTC+8)260621-19:44:32 (UTC+8)
35804_NoSemanticGlobalInvariance 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:43:59 (UTC+8)260621-19:44:27 (UTC+8)
35703_NoOrderInvariance 完成:Val=93.86 Test=93.64 MLP=92.17 GNN=92.82 260621-19:43:55 (UTC+8)260621-19:44:22 (UTC+8)
35603_NoOrderInvariance Phase2 完成:Val=93.86 Test=93.64 best_epoch=1500 260621-19:43:54 (UTC+8)260621-19:44:21 (UTC+8)
35503_NoOrderInvariance Phase2 epoch=1700/1706 Val=93.58 Test=93.51 best=93.86@1500 260621-19:43:53 (UTC+8)260621-19:44:20 (UTC+8)
35403_NoOrderInvariance Phase2 epoch=1600/1706 Val=93.76 Test=93.74 best=93.86@1500 260621-19:43:50 (UTC+8)260621-19:44:18 (UTC+8)
35303_NoOrderInvariance Phase2 epoch=1500/1706 Val=93.86 Test=93.64 best=93.86@1500 260621-19:43:48 (UTC+8)260621-19:44:16 (UTC+8)
35203_NoOrderInvariance Phase2 epoch=1400/1706 Val=93.61 Test=93.61 best=93.84@1370 260621-19:43:46 (UTC+8)260621-19:44:13 (UTC+8)
35103_NoOrderInvariance Phase2 epoch=1300/1706 Val=93.76 Test=93.51 best=93.76@1025 260621-19:43:44 (UTC+8)260621-19:44:11 (UTC+8)
35003_NoOrderInvariance Phase2 epoch=1200/1706 Val=93.33 Test=93.53 best=93.76@1025 260621-19:43:42 (UTC+8)260621-19:44:09 (UTC+8)
34903_NoOrderInvariance Phase2 epoch=1100/1706 Val=92.65 Test=93.33 best=93.76@1025 260621-19:43:39 (UTC+8)260621-19:44:06 (UTC+8)
34803_NoOrderInvariance Phase2 epoch=1000/1706 Val=92.90 Test=93.41 best=93.74@900 260621-19:43:37 (UTC+8)260621-19:44:04 (UTC+8)
34703_NoOrderInvariance Phase2 epoch=900/1706 Val=93.74 Test=93.33 best=93.74@900 260621-19:43:35 (UTC+8)260621-19:44:02 (UTC+8)
34603_NoOrderInvariance Phase2 epoch=800/1706 Val=93.10 Test=93.10 best=93.58@715 260621-19:43:33 (UTC+8)260621-19:44:00 (UTC+8)
34503_NoOrderInvariance Phase2 epoch=700/1706 Val=93.41 Test=93.66 best=93.48@690 260621-19:43:31 (UTC+8)260621-19:43:58 (UTC+8)
34403_NoOrderInvariance Phase2 epoch=600/1706 Val=93.28 Test=93.91 best=93.46@550 260621-19:43:29 (UTC+8)260621-19:43:55 (UTC+8)
34303_NoOrderInvariance Phase2 epoch=500/1706 Val=92.82 Test=93.05 best=93.20@480 260621-19:43:28 (UTC+8)260621-19:43:54 (UTC+8)
34203_NoOrderInvariance Phase2 epoch=400/1706 Val=92.80 Test=93.15 best=93.10@355 260621-19:43:26 (UTC+8)260621-19:43:52 (UTC+8)
34103_NoOrderInvariance Phase2 epoch=300/1706 Val=92.01 Test=92.22 best=92.39@270 260621-19:43:24 (UTC+8)260621-19:43:50 (UTC+8)
34003_NoOrderInvariance Phase2 epoch=200/1706 Val=91.20 Test=91.56 best=91.20@200 260621-19:43:22 (UTC+8)260621-19:43:48 (UTC+8)
33903_NoOrderInvariance Phase2 epoch=100/1706 Val=88.87 Test=89.35 best=88.89@95 260621-19:43:20 (UTC+8)260621-19:43:46 (UTC+8)
33803_NoOrderInvariance Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-19:43:18 (UTC+8)260621-19:43:44 (UTC+8)
33703_NoOrderInvariance Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-19:43:17 (UTC+8)260621-19:43:43 (UTC+8)
33603_NoOrderInvariance Phase1 完成:best=93.43@155 targets=19717 260621-19:43:14 (UTC+8)260621-19:43:40 (UTC+8)
33503_NoOrderInvariance Phase1 epoch=2200/2256 best=93.43@155 260621-19:43:03 (UTC+8)260621-19:43:28 (UTC+8)
33403_NoOrderInvariance Phase1 epoch=2100/2256 best=93.43@155 260621-19:42:42 (UTC+8)260621-19:43:06 (UTC+8)
33303_NoOrderInvariance Phase1 epoch=2000/2256 best=93.43@155 260621-19:42:21 (UTC+8)260621-19:42:45 (UTC+8)
33203_NoOrderInvariance Phase1 epoch=1900/2256 best=93.43@155 260621-19:42:01 (UTC+8)260621-19:42:24 (UTC+8)
33103_NoOrderInvariance Phase1 epoch=1800/2256 best=93.43@155 260621-19:41:41 (UTC+8)260621-19:42:03 (UTC+8)
33003_NoOrderInvariance Phase1 epoch=1700/2256 best=93.43@155 260621-19:41:20 (UTC+8)260621-19:41:41 (UTC+8)
32903_NoOrderInvariance Phase1 epoch=1600/2256 best=93.43@155 260621-19:41:00 (UTC+8)260621-19:41:20 (UTC+8)
32803_NoOrderInvariance Phase1 epoch=1500/2256 best=93.43@155 260621-19:40:41 (UTC+8)260621-19:41:00 (UTC+8)
32703_NoOrderInvariance Phase1 epoch=1400/2256 best=93.43@155 260621-19:40:14 (UTC+8)260621-19:40:33 (UTC+8)
32603_NoOrderInvariance Phase1 epoch=1300/2256 best=93.43@155 260621-19:39:48 (UTC+8)260621-19:40:05 (UTC+8)
32503_NoOrderInvariance Phase1 epoch=1200/2256 best=93.43@155 260621-19:39:23 (UTC+8)260621-19:39:39 (UTC+8)
32403_NoOrderInvariance Phase1 epoch=1100/2256 best=93.43@155 260621-19:38:57 (UTC+8)260621-19:39:12 (UTC+8)
32303_NoOrderInvariance Phase1 epoch=1000/2256 best=93.43@155 260621-19:38:32 (UTC+8)260621-19:38:46 (UTC+8)
32203_NoOrderInvariance Phase1 epoch=900/2256 best=93.43@155 260621-19:38:07 (UTC+8)260621-19:38:20 (UTC+8)
32103_NoOrderInvariance Phase1 epoch=800/2256 best=93.43@155 260621-19:37:41 (UTC+8)260621-19:37:53 (UTC+8)
32003_NoOrderInvariance Phase1 epoch=700/2256 best=93.43@155 260621-19:37:16 (UTC+8)260621-19:37:27 (UTC+8)
31903_NoOrderInvariance Phase1 epoch=600/2256 best=93.43@155 260621-19:36:51 (UTC+8)260621-19:37:00 (UTC+8)
31803_NoOrderInvariance Phase1 epoch=500/2256 best=93.43@155 260621-19:36:24 (UTC+8)260621-19:36:33 (UTC+8)
31703_NoOrderInvariance Phase1 epoch=400/2256 best=93.43@155 260621-19:35:59 (UTC+8)260621-19:36:07 (UTC+8)
31603_NoOrderInvariance Phase1 epoch=300/2256 best=93.43@155 260621-19:35:33 (UTC+8)260621-19:35:40 (UTC+8)
31503_NoOrderInvariance Phase1 epoch=200/2256 best=93.43@155 260621-19:35:08 (UTC+8)260621-19:35:14 (UTC+8)
31403_NoOrderInvariance Phase1 epoch=100/2256 best=93.20@97 260621-19:34:42 (UTC+8)260621-19:34:46 (UTC+8)
31303_NoOrderInvariance Phase1 epoch=1/2256 best=39.79@1 260621-19:34:17 (UTC+8)260621-19:34:20 (UTC+8)
31203_NoOrderInvariance Phase1 启动:No topology order invariance 260621-19:34:15 (UTC+8)260621-19:34:19 (UTC+8)
31103_NoOrderInvariance 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:34:10 (UTC+8)260621-19:34:13 (UTC+8)
31002_RawHiddenDistill 完成:Val=90.24 Test=90.39 MLP=88.74 GNN=88.62 260621-19:34:05 (UTC+8)260621-19:34:08 (UTC+8)
30902_RawHiddenDistill Phase2 完成:Val=90.24 Test=90.39 best_epoch=650 260621-19:34:04 (UTC+8)260621-19:34:07 (UTC+8)
30802_RawHiddenDistill Phase2 epoch=1700/1706 Val=88.79 Test=88.92 best=90.24@650 260621-19:34:03 (UTC+8)260621-19:34:06 (UTC+8)
30702_RawHiddenDistill Phase2 epoch=1600/1706 Val=85.32 Test=85.45 best=90.24@650 260621-19:34:01 (UTC+8)260621-19:34:03 (UTC+8)
30602_RawHiddenDistill Phase2 epoch=1500/1706 Val=89.70 Test=89.53 best=90.24@650 260621-19:33:59 (UTC+8)260621-19:34:01 (UTC+8)
30502_RawHiddenDistill Phase2 epoch=1400/1706 Val=88.89 Test=89.83 best=90.24@650 260621-19:33:57 (UTC+8)260621-19:33:59 (UTC+8)
30402_RawHiddenDistill Phase2 epoch=1300/1706 Val=88.71 Test=88.59 best=90.24@650 260621-19:33:55 (UTC+8)260621-19:33:57 (UTC+8)
30302_RawHiddenDistill Phase2 epoch=1200/1706 Val=88.71 Test=88.64 best=90.24@650 260621-19:33:53 (UTC+8)260621-19:33:55 (UTC+8)
30202_RawHiddenDistill Phase2 epoch=1100/1706 Val=89.35 Test=89.22 best=90.24@650 260621-19:33:51 (UTC+8)260621-19:33:53 (UTC+8)
30102_RawHiddenDistill Phase2 epoch=900/1706 Val=89.45 Test=89.48 best=90.24@650 260621-19:33:43 (UTC+8)260621-19:33:45 (UTC+8)
30002_RawHiddenDistill Phase2 epoch=800/1706 Val=89.55 Test=90.29 best=90.24@650 260621-19:33:41 (UTC+8)260621-19:33:43 (UTC+8)
29902_RawHiddenDistill Phase2 epoch=700/1706 Val=89.98 Test=90.31 best=90.24@650 260621-19:33:39 (UTC+8)260621-19:33:41 (UTC+8)
29802_RawHiddenDistill Phase2 epoch=600/1706 Val=90.01 Test=90.04 best=90.21@595 260621-19:33:36 (UTC+8)260621-19:33:38 (UTC+8)
29702_RawHiddenDistill Phase2 epoch=500/1706 Val=73.14 Test=73.05 best=90.16@480 260621-19:33:35 (UTC+8)260621-19:33:36 (UTC+8)
29602_RawHiddenDistill Phase2 epoch=400/1706 Val=89.53 Test=89.88 best=89.93@360 260621-19:33:33 (UTC+8)260621-19:33:34 (UTC+8)
29502_RawHiddenDistill Phase2 epoch=300/1706 Val=80.17 Test=81.62 best=89.42@260 260621-19:33:30 (UTC+8)260621-19:33:32 (UTC+8)
29402_RawHiddenDistill Phase2 epoch=200/1706 Val=88.26 Test=88.64 best=89.04@170 260621-19:33:28 (UTC+8)260621-19:33:30 (UTC+8)
29302_RawHiddenDistill Phase2 epoch=100/1706 Val=83.24 Test=84.10 best=87.80@80 260621-19:33:25 (UTC+8)260621-19:33:26 (UTC+8)
29202_RawHiddenDistill Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-19:33:23 (UTC+8)260621-19:33:24 (UTC+8)
29102_RawHiddenDistill Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-19:33:22 (UTC+8)260621-19:33:23 (UTC+8)
29002_RawHiddenDistill 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:33:15 (UTC+8)260621-19:33:16 (UTC+8)
28901_TaskOnly 完成:Val=90.06 Test=89.78 MLP=88.34 GNN=88.79 260621-19:33:11 (UTC+8)260621-19:33:12 (UTC+8)
28801_TaskOnly Phase2 完成:Val=90.06 Test=89.78 best_epoch=230 260621-19:33:10 (UTC+8)260621-19:33:11 (UTC+8)
28701_TaskOnly Phase2 epoch=1700/1706 Val=87.37 Test=87.30 best=90.06@230 260621-19:33:09 (UTC+8)260621-19:33:10 (UTC+8)
28601_TaskOnly Phase2 epoch=1600/1706 Val=82.96 Test=82.96 best=90.06@230 260621-19:33:06 (UTC+8)260621-19:33:08 (UTC+8)
28501_TaskOnly Phase2 epoch=1500/1706 Val=87.88 Test=88.13 best=90.06@230 260621-19:33:04 (UTC+8)260621-19:33:06 (UTC+8)
28401_TaskOnly Phase2 epoch=1400/1706 Val=88.18 Test=88.03 best=90.06@230 260621-19:33:02 (UTC+8)260621-19:33:04 (UTC+8)
28301_TaskOnly Phase2 epoch=1300/1706 Val=87.52 Test=88.77 best=90.06@230 260621-19:33:00 (UTC+8)260621-19:33:02 (UTC+8)
28201_TaskOnly Phase2 epoch=1200/1706 Val=88.49 Test=89.50 best=90.06@230 260621-19:32:59 (UTC+8)260621-19:33:00 (UTC+8)
28101_TaskOnly Phase2 epoch=1100/1706 Val=86.99 Test=88.44 best=90.06@230 260621-19:32:57 (UTC+8)260621-19:32:58 (UTC+8)
28001_TaskOnly Phase2 epoch=1000/1706 Val=88.66 Test=89.40 best=90.06@230 260621-19:32:55 (UTC+8)260621-19:32:56 (UTC+8)
27901_TaskOnly Phase2 epoch=900/1706 Val=88.11 Test=88.18 best=90.06@230 260621-19:32:53 (UTC+8)260621-19:32:54 (UTC+8)
27801_TaskOnly Phase2 epoch=800/1706 Val=87.75 Test=87.65 best=90.06@230 260621-19:32:51 (UTC+8)260621-19:32:52 (UTC+8)
27701_TaskOnly Phase2 epoch=700/1706 Val=88.99 Test=89.27 best=90.06@230 260621-19:32:49 (UTC+8)260621-19:32:51 (UTC+8)
27601_TaskOnly Phase2 epoch=600/1706 Val=88.41 Test=89.20 best=90.06@230 260621-19:32:47 (UTC+8)260621-19:32:48 (UTC+8)
27501_TaskOnly Phase2 epoch=500/1706 Val=86.38 Test=86.97 best=90.06@230 260621-19:32:45 (UTC+8)260621-19:32:46 (UTC+8)
27401_TaskOnly Phase2 epoch=400/1706 Val=89.40 Test=89.60 best=90.06@230 260621-19:32:42 (UTC+8)260621-19:32:43 (UTC+8)
27301_TaskOnly Phase2 epoch=300/1706 Val=89.09 Test=90.01 best=90.06@230 260621-19:32:40 (UTC+8)260621-19:32:40 (UTC+8)
27201_TaskOnly Phase2 epoch=200/1706 Val=89.96 Test=89.83 best=89.96@200 260621-19:32:38 (UTC+8)260621-19:32:38 (UTC+8)
27101_TaskOnly Phase2 epoch=1/1706 Val=55.47 Test=55.91 best=55.47@1 260621-19:32:27 (UTC+8)260621-19:32:29 (UTC+8)
27001_TaskOnly Phase2 启动:distill_nodes=0 alpha_d=0.0 260621-19:32:26 (UTC+8)260621-19:32:28 (UTC+8)
26901_TaskOnly 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:32:21 (UTC+8)260621-19:32:23 (UTC+8)
268start Remaining_01_to_13_standard_matrix 260621-19:32:17 (UTC+8)260621-19:32:18 (UTC+8)
267done collect_results_poly 260621-19:32:15 (UTC+8)260621-19:32:17 (UTC+8)
266start collect_results_poly 260621-19:32:15 (UTC+8)260621-19:32:16 (UTC+8)
265done Poly_18_VarianceAwareSemanticPooling 260621-19:32:14 (UTC+8)260621-19:32:15 (UTC+8)
26418_VarianceAwareSemanticPooling 完成:Val=93.79 Test=93.13 MLP=90.39 GNN=92.47 260621-19:32:12 (UTC+8)260621-19:32:13 (UTC+8)
26318_VarianceAwareSemanticPooling Phase2 完成:Val=93.79 Test=93.13 best_epoch=1270 260621-19:32:11 (UTC+8)260621-19:32:12 (UTC+8)
26218_VarianceAwareSemanticPooling Phase2 epoch=1700/1706 Val=92.82 Test=93.08 best=93.79@1270 260621-19:32:10 (UTC+8)260621-19:32:11 (UTC+8)
26118_VarianceAwareSemanticPooling Phase2 epoch=1600/1706 Val=93.30 Test=92.98 best=93.79@1270 260621-19:32:08 (UTC+8)260621-19:32:09 (UTC+8)
26018_VarianceAwareSemanticPooling Phase2 epoch=1500/1706 Val=92.92 Test=93.03 best=93.79@1270 260621-19:32:06 (UTC+8)260621-19:32:06 (UTC+8)
25918_VarianceAwareSemanticPooling Phase2 epoch=1400/1706 Val=93.20 Test=92.98 best=93.79@1270 260621-19:32:03 (UTC+8)260621-19:32:04 (UTC+8)
25818_VarianceAwareSemanticPooling Phase2 epoch=1300/1706 Val=93.58 Test=92.93 best=93.79@1270 260621-19:32:02 (UTC+8)260621-19:32:02 (UTC+8)
25718_VarianceAwareSemanticPooling Phase2 epoch=1200/1706 Val=93.51 Test=92.57 best=93.76@1185 260621-19:31:59 (UTC+8)260621-19:32:00 (UTC+8)
25618_VarianceAwareSemanticPooling Phase2 epoch=1100/1706 Val=93.05 Test=93.08 best=93.46@1050 260621-19:31:55 (UTC+8)260621-19:31:58 (UTC+8)
25518_VarianceAwareSemanticPooling Phase2 epoch=1000/1706 Val=92.67 Test=92.77 best=93.43@795 260621-19:31:53 (UTC+8)260621-19:31:55 (UTC+8)
25418_VarianceAwareSemanticPooling Phase2 epoch=900/1706 Val=93.23 Test=93.03 best=93.43@795 260621-19:31:51 (UTC+8)260621-19:31:53 (UTC+8)
25318_VarianceAwareSemanticPooling Phase2 epoch=800/1706 Val=93.36 Test=92.60 best=93.43@795 260621-19:31:49 (UTC+8)260621-19:31:51 (UTC+8)
25218_VarianceAwareSemanticPooling Phase2 epoch=700/1706 Val=92.97 Test=92.88 best=93.25@600 260621-19:31:47 (UTC+8)260621-19:31:49 (UTC+8)
25118_VarianceAwareSemanticPooling Phase2 epoch=600/1706 Val=93.25 Test=92.60 best=93.25@600 260621-19:31:45 (UTC+8)260621-19:31:47 (UTC+8)
25018_VarianceAwareSemanticPooling Phase2 epoch=500/1706 Val=92.59 Test=92.44 best=92.85@435 260621-19:31:43 (UTC+8)260621-19:31:45 (UTC+8)
24918_VarianceAwareSemanticPooling Phase2 epoch=400/1706 Val=92.39 Test=91.78 best=92.47@375 260621-19:31:41 (UTC+8)260621-19:31:42 (UTC+8)
24818_VarianceAwareSemanticPooling Phase2 epoch=300/1706 Val=91.61 Test=91.73 best=91.88@280 260621-19:31:38 (UTC+8)260621-19:31:40 (UTC+8)
24718_VarianceAwareSemanticPooling Phase2 epoch=200/1706 Val=90.84 Test=91.02 best=90.92@195 260621-19:31:36 (UTC+8)260621-19:31:38 (UTC+8)
24618_VarianceAwareSemanticPooling Phase2 epoch=100/1706 Val=89.04 Test=89.63 best=89.04@100 260621-19:31:34 (UTC+8)260621-19:31:35 (UTC+8)
24518_VarianceAwareSemanticPooling Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-19:31:31 (UTC+8)260621-19:31:33 (UTC+8)
24418_VarianceAwareSemanticPooling Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-19:31:30 (UTC+8)260621-19:31:31 (UTC+8)
24318_VarianceAwareSemanticPooling Phase1 完成:best=93.43@183 targets=19717 260621-19:31:26 (UTC+8)260621-19:31:28 (UTC+8)
24218_VarianceAwareSemanticPooling Phase1 epoch=2200/2256 best=93.43@183 260621-19:31:13 (UTC+8)260621-19:31:15 (UTC+8)
24118_VarianceAwareSemanticPooling Phase1 epoch=2100/2256 best=93.43@183 260621-19:30:52 (UTC+8)260621-19:30:54 (UTC+8)
24018_VarianceAwareSemanticPooling Phase1 epoch=2000/2256 best=93.43@183 260621-19:30:30 (UTC+8)260621-19:30:32 (UTC+8)
23918_VarianceAwareSemanticPooling Phase1 epoch=1900/2256 best=93.43@183 260621-19:30:10 (UTC+8)260621-19:30:11 (UTC+8)
23818_VarianceAwareSemanticPooling Phase1 epoch=1800/2256 best=93.43@183 260621-19:29:48 (UTC+8)260621-19:29:50 (UTC+8)
23718_VarianceAwareSemanticPooling Phase1 epoch=1700/2256 best=93.43@183 260621-19:29:27 (UTC+8)260621-19:29:28 (UTC+8)
23618_VarianceAwareSemanticPooling Phase1 epoch=1600/2256 best=93.43@183 260621-19:29:05 (UTC+8)260621-19:29:07 (UTC+8)
23518_VarianceAwareSemanticPooling Phase1 epoch=1500/2256 best=93.43@183 260621-19:28:44 (UTC+8)260621-19:28:45 (UTC+8)
23418_VarianceAwareSemanticPooling Phase1 epoch=1400/2256 best=93.43@183 260621-19:28:18 (UTC+8)260621-19:28:20 (UTC+8)
23318_VarianceAwareSemanticPooling Phase1 epoch=1300/2256 best=93.43@183 260621-19:27:52 (UTC+8)260621-19:27:53 (UTC+8)
23218_VarianceAwareSemanticPooling Phase1 epoch=1200/2256 best=93.43@183 260621-19:27:24 (UTC+8)260621-19:27:26 (UTC+8)
23118_VarianceAwareSemanticPooling Phase1 epoch=1100/2256 best=93.43@183 260621-19:26:59 (UTC+8)260621-19:27:00 (UTC+8)
23018_VarianceAwareSemanticPooling Phase1 epoch=1000/2256 best=93.43@183 260621-19:26:31 (UTC+8)260621-19:26:32 (UTC+8)
22918_VarianceAwareSemanticPooling Phase1 epoch=900/2256 best=93.43@183 260621-19:26:04 (UTC+8)260621-19:26:05 (UTC+8)
22818_VarianceAwareSemanticPooling Phase1 epoch=800/2256 best=93.43@183 260621-19:25:37 (UTC+8)260621-19:25:39 (UTC+8)
22718_VarianceAwareSemanticPooling Phase1 epoch=700/2256 best=93.43@183 260621-19:25:11 (UTC+8)260621-19:25:11 (UTC+8)
22618_VarianceAwareSemanticPooling Phase1 epoch=600/2256 best=93.43@183 260621-19:24:43 (UTC+8)260621-19:24:44 (UTC+8)
22518_VarianceAwareSemanticPooling Phase1 epoch=500/2256 best=93.43@183 260621-19:24:16 (UTC+8)260621-19:24:18 (UTC+8)
22418_VarianceAwareSemanticPooling Phase1 epoch=400/2256 best=93.43@183 260621-19:23:48 (UTC+8)260621-19:23:50 (UTC+8)
22318_VarianceAwareSemanticPooling Phase1 epoch=300/2256 best=93.43@183 260621-19:23:22 (UTC+8)260621-19:23:24 (UTC+8)
22218_VarianceAwareSemanticPooling Phase1 epoch=200/2256 best=93.43@183 260621-19:22:57 (UTC+8)260621-19:22:57 (UTC+8)
22118_VarianceAwareSemanticPooling Phase1 epoch=100/2256 best=93.20@92 260621-19:22:29 (UTC+8)260621-19:22:30 (UTC+8)
22018_VarianceAwareSemanticPooling Phase1 epoch=1/2256 best=39.79@1 260621-19:22:03 (UTC+8)260621-19:22:05 (UTC+8)
21918_VarianceAwareSemanticPooling Phase1 启动:Variance-aware semantic pooling 260621-19:22:02 (UTC+8)260621-19:22:03 (UTC+8)
21818_VarianceAwareSemanticPooling 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:21:57 (UTC+8)260621-19:21:58 (UTC+8)
217start Poly_18_VarianceAwareSemanticPooling 260621-19:21:53 (UTC+8)260621-19:21:54 (UTC+8)
216done Poly_17_GeometricMedianTopology 260621-19:21:52 (UTC+8)260621-19:21:53 (UTC+8)
21517_GeometricMedianTopology 完成:Val=93.89 Test=93.74 MLP=93.13 GNN=92.62 260621-19:21:50 (UTC+8)260621-19:21:51 (UTC+8)
21417_GeometricMedianTopology Phase2 完成:Val=93.89 Test=93.74 best_epoch=1255 260621-19:21:49 (UTC+8)260621-19:21:50 (UTC+8)
21317_GeometricMedianTopology Phase2 epoch=1700/1706 Val=93.63 Test=93.76 best=93.89@1255 260621-19:21:48 (UTC+8)260621-19:21:49 (UTC+8)
21217_GeometricMedianTopology Phase2 epoch=1600/1706 Val=93.43 Test=93.56 best=93.89@1255 260621-19:21:46 (UTC+8)260621-19:21:46 (UTC+8)
21117_GeometricMedianTopology Phase2 epoch=1500/1706 Val=93.76 Test=93.26 best=93.89@1255 260621-19:21:42 (UTC+8)260621-19:21:44 (UTC+8)
21017_GeometricMedianTopology Phase2 epoch=1400/1706 Val=93.38 Test=93.56 best=93.89@1255 260621-19:21:39 (UTC+8)260621-19:21:41 (UTC+8)
20917_GeometricMedianTopology Phase2 epoch=1300/1706 Val=93.63 Test=93.46 best=93.89@1255 260621-19:21:37 (UTC+8)260621-19:21:39 (UTC+8)
20817_GeometricMedianTopology Phase2 epoch=1200/1706 Val=93.46 Test=93.81 best=93.81@1060 260621-19:21:35 (UTC+8)260621-19:21:36 (UTC+8)
20717_GeometricMedianTopology Phase2 epoch=1100/1706 Val=93.56 Test=93.86 best=93.81@1060 260621-19:21:32 (UTC+8)260621-19:21:34 (UTC+8)
20617_GeometricMedianTopology Phase2 epoch=1000/1706 Val=93.61 Test=94.02 best=93.76@990 260621-19:21:30 (UTC+8)260621-19:21:32 (UTC+8)
20517_GeometricMedianTopology Phase2 epoch=900/1706 Val=93.46 Test=93.76 best=93.69@880 260621-19:21:29 (UTC+8)260621-19:21:30 (UTC+8)
20417_GeometricMedianTopology Phase2 epoch=800/1706 Val=93.33 Test=93.56 best=93.53@625 260621-19:21:27 (UTC+8)260621-19:21:28 (UTC+8)
20317_GeometricMedianTopology Phase2 epoch=700/1706 Val=93.38 Test=93.84 best=93.53@625 260621-19:21:25 (UTC+8)260621-19:21:26 (UTC+8)
20217_GeometricMedianTopology Phase2 epoch=600/1706 Val=93.38 Test=93.38 best=93.43@595 260621-19:21:23 (UTC+8)260621-19:21:24 (UTC+8)
20117_GeometricMedianTopology Phase2 epoch=500/1706 Val=93.03 Test=92.98 best=93.36@480 260621-19:21:21 (UTC+8)260621-19:21:22 (UTC+8)
20017_GeometricMedianTopology Phase2 epoch=400/1706 Val=92.95 Test=92.93 best=92.95@380 260621-19:21:19 (UTC+8)260621-19:21:20 (UTC+8)
19917_GeometricMedianTopology Phase2 epoch=300/1706 Val=92.04 Test=92.29 best=92.34@295 260621-19:21:17 (UTC+8)260621-19:21:18 (UTC+8)
19817_GeometricMedianTopology Phase2 epoch=200/1706 Val=91.00 Test=91.10 best=91.12@195 260621-19:21:15 (UTC+8)260621-19:21:16 (UTC+8)
19717_GeometricMedianTopology Phase2 epoch=100/1706 Val=88.99 Test=89.58 best=88.99@100 260621-19:21:13 (UTC+8)260621-19:21:13 (UTC+8)
19617_GeometricMedianTopology Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-19:21:10 (UTC+8)260621-19:21:11 (UTC+8)
19517_GeometricMedianTopology Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-19:21:09 (UTC+8)260621-19:21:10 (UTC+8)
19417_GeometricMedianTopology Phase1 完成:best=93.41@136 targets=19717 260621-19:21:05 (UTC+8)260621-19:21:07 (UTC+8)
19317_GeometricMedianTopology Phase1 epoch=2200/2256 best=93.41@136 260621-19:20:54 (UTC+8)260621-19:20:55 (UTC+8)
19217_GeometricMedianTopology Phase1 epoch=2100/2256 best=93.41@136 260621-19:20:32 (UTC+8)260621-19:20:33 (UTC+8)
19117_GeometricMedianTopology Phase1 epoch=2000/2256 best=93.41@136 260621-19:20:11 (UTC+8)260621-19:20:12 (UTC+8)
19017_GeometricMedianTopology Phase1 epoch=1900/2256 best=93.41@136 260621-19:19:50 (UTC+8)260621-19:19:52 (UTC+8)
18917_GeometricMedianTopology Phase1 epoch=1800/2256 best=93.41@136 260621-19:19:30 (UTC+8)260621-19:19:31 (UTC+8)
18817_GeometricMedianTopology Phase1 epoch=1700/2256 best=93.41@136 260621-19:19:07 (UTC+8)260621-19:19:09 (UTC+8)
18717_GeometricMedianTopology Phase1 epoch=1600/2256 best=93.41@136 260621-19:18:46 (UTC+8)260621-19:18:48 (UTC+8)
18617_GeometricMedianTopology Phase1 epoch=1500/2256 best=93.41@136 260621-19:18:26 (UTC+8)260621-19:18:28 (UTC+8)
18517_GeometricMedianTopology Phase1 epoch=1400/2256 best=93.41@136 260621-19:17:59 (UTC+8)260621-19:18:00 (UTC+8)
18417_GeometricMedianTopology Phase1 epoch=1300/2256 best=93.41@136 260621-19:17:31 (UTC+8)260621-19:17:33 (UTC+8)
18317_GeometricMedianTopology Phase1 epoch=1200/2256 best=93.41@136 260621-19:17:05 (UTC+8)260621-19:17:07 (UTC+8)
18217_GeometricMedianTopology Phase1 epoch=1100/2256 best=93.41@136 260621-19:16:38 (UTC+8)260621-19:16:39 (UTC+8)
18117_GeometricMedianTopology Phase1 epoch=1000/2256 best=93.41@136 260621-19:16:11 (UTC+8)260621-19:16:13 (UTC+8)
18017_GeometricMedianTopology Phase1 epoch=900/2256 best=93.41@136 260621-19:15:46 (UTC+8)260621-19:15:47 (UTC+8)
17917_GeometricMedianTopology Phase1 epoch=800/2256 best=93.41@136 260621-19:15:19 (UTC+8)260621-19:15:19 (UTC+8)
17817_GeometricMedianTopology Phase1 epoch=700/2256 best=93.41@136 260621-19:14:52 (UTC+8)260621-19:14:54 (UTC+8)
17717_GeometricMedianTopology Phase1 epoch=600/2256 best=93.41@136 260621-19:14:25 (UTC+8)260621-19:14:27 (UTC+8)
17617_GeometricMedianTopology Phase1 epoch=500/2256 best=93.41@136 260621-19:13:58 (UTC+8)260621-19:13:59 (UTC+8)
17517_GeometricMedianTopology Phase1 epoch=400/2256 best=93.41@136 260621-19:13:32 (UTC+8)260621-19:13:33 (UTC+8)
17417_GeometricMedianTopology Phase1 epoch=300/2256 best=93.41@136 260621-19:13:04 (UTC+8)260621-19:13:05 (UTC+8)
17317_GeometricMedianTopology Phase1 epoch=200/2256 best=93.41@136 260621-19:12:37 (UTC+8)260621-19:12:39 (UTC+8)
17217_GeometricMedianTopology Phase1 epoch=100/2256 best=93.18@92 260621-19:12:10 (UTC+8)260621-19:12:12 (UTC+8)
17117_GeometricMedianTopology Phase1 epoch=1/2256 best=39.79@1 260621-19:11:45 (UTC+8)260621-19:11:46 (UTC+8)
17017_GeometricMedianTopology Phase1 启动:Robust topology center by cross-K geometric median 260621-19:11:43 (UTC+8)260621-19:11:44 (UTC+8)
16917_GeometricMedianTopology 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:11:37 (UTC+8)260621-19:11:39 (UTC+8)
168start Poly_17_GeometricMedianTopology 260621-19:11:33 (UTC+8)260621-19:11:35 (UTC+8)
167done Poly_15_UncertaintyWeightedAggregation 260621-19:11:32 (UTC+8)260621-19:11:34 (UTC+8)
16615_UncertaintyWeightedAggregation 完成:Val=94.01 Test=93.94 MLP=92.19 GNN=92.34 260621-19:11:30 (UTC+8)260621-19:11:32 (UTC+8)
16515_UncertaintyWeightedAggregation Phase2 完成:Val=94.01 Test=93.94 best_epoch=1490 260621-19:11:29 (UTC+8)260621-19:11:31 (UTC+8)
16415_UncertaintyWeightedAggregation Phase2 epoch=1700/1706 Val=93.58 Test=93.91 best=94.01@1490 260621-19:11:28 (UTC+8)260621-19:11:29 (UTC+8)
16315_UncertaintyWeightedAggregation Phase2 epoch=1500/1706 Val=93.91 Test=93.79 best=94.01@1490 260621-19:11:20 (UTC+8)260621-19:11:21 (UTC+8)
16215_UncertaintyWeightedAggregation Phase2 epoch=1400/1706 Val=93.66 Test=93.81 best=93.99@1175 260621-19:11:18 (UTC+8)260621-19:11:19 (UTC+8)
16115_UncertaintyWeightedAggregation Phase2 epoch=1300/1706 Val=93.25 Test=93.31 best=93.99@1175 260621-19:11:16 (UTC+8)260621-19:11:17 (UTC+8)
16015_UncertaintyWeightedAggregation Phase2 epoch=1200/1706 Val=93.86 Test=93.99 best=93.99@1175 260621-19:11:14 (UTC+8)260621-19:11:15 (UTC+8)
15915_UncertaintyWeightedAggregation Phase2 epoch=1100/1706 Val=93.63 Test=94.02 best=93.91@920 260621-19:11:12 (UTC+8)260621-19:11:13 (UTC+8)
15815_UncertaintyWeightedAggregation Phase2 epoch=1000/1706 Val=93.71 Test=93.91 best=93.91@920 260621-19:11:10 (UTC+8)260621-19:11:11 (UTC+8)
15715_UncertaintyWeightedAggregation Phase2 epoch=900/1706 Val=93.61 Test=93.76 best=93.89@790 260621-19:11:08 (UTC+8)260621-19:11:09 (UTC+8)
15615_UncertaintyWeightedAggregation Phase2 epoch=800/1706 Val=93.69 Test=93.79 best=93.89@790 260621-19:11:04 (UTC+8)260621-19:11:07 (UTC+8)
15515_UncertaintyWeightedAggregation Phase2 epoch=700/1706 Val=93.56 Test=93.76 best=93.69@680 260621-19:11:02 (UTC+8)260621-19:11:04 (UTC+8)
15415_UncertaintyWeightedAggregation Phase2 epoch=600/1706 Val=93.23 Test=93.59 best=93.36@495 260621-19:11:00 (UTC+8)260621-19:11:02 (UTC+8)
15315_UncertaintyWeightedAggregation Phase2 epoch=500/1706 Val=92.90 Test=93.51 best=93.36@495 260621-19:10:58 (UTC+8)260621-19:11:00 (UTC+8)
15215_UncertaintyWeightedAggregation Phase2 epoch=400/1706 Val=92.70 Test=93.03 best=92.97@365 260621-19:10:56 (UTC+8)260621-19:10:58 (UTC+8)
15115_UncertaintyWeightedAggregation Phase2 epoch=300/1706 Val=92.54 Test=92.32 best=92.62@280 260621-19:10:54 (UTC+8)260621-19:10:56 (UTC+8)
15015_UncertaintyWeightedAggregation Phase2 epoch=200/1706 Val=90.26 Test=89.98 best=91.12@180 260621-19:10:52 (UTC+8)260621-19:10:53 (UTC+8)
14915_UncertaintyWeightedAggregation Phase2 epoch=100/1706 Val=88.92 Test=89.48 best=88.92@100 260621-19:10:50 (UTC+8)260621-19:10:51 (UTC+8)
14815_UncertaintyWeightedAggregation Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-19:10:48 (UTC+8)260621-19:10:50 (UTC+8)
14715_UncertaintyWeightedAggregation Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-19:10:47 (UTC+8)260621-19:10:48 (UTC+8)
14615_UncertaintyWeightedAggregation Phase1 完成:best=93.38@202 targets=19717 260621-19:10:44 (UTC+8)260621-19:10:45 (UTC+8)
14515_UncertaintyWeightedAggregation Phase1 epoch=2200/2256 best=93.38@202 260621-19:10:33 (UTC+8)260621-19:10:34 (UTC+8)
14415_UncertaintyWeightedAggregation Phase1 epoch=2100/2256 best=93.38@202 260621-19:10:10 (UTC+8)260621-19:10:11 (UTC+8)
14315_UncertaintyWeightedAggregation Phase1 epoch=2000/2256 best=93.38@202 260621-19:09:49 (UTC+8)260621-19:09:51 (UTC+8)
14215_UncertaintyWeightedAggregation Phase1 epoch=1900/2256 best=93.38@202 260621-19:09:28 (UTC+8)260621-19:09:30 (UTC+8)
14115_UncertaintyWeightedAggregation Phase1 epoch=1800/2256 best=93.38@202 260621-19:09:08 (UTC+8)260621-19:09:09 (UTC+8)
14015_UncertaintyWeightedAggregation Phase1 epoch=1700/2256 best=93.38@202 260621-19:08:46 (UTC+8)260621-19:08:47 (UTC+8)
13915_UncertaintyWeightedAggregation Phase1 epoch=1600/2256 best=93.38@202 260621-19:08:24 (UTC+8)260621-19:08:26 (UTC+8)
13815_UncertaintyWeightedAggregation Phase1 epoch=1500/2256 best=93.38@202 260621-19:08:05 (UTC+8)260621-19:08:06 (UTC+8)
13715_UncertaintyWeightedAggregation Phase1 epoch=1400/2256 best=93.38@202 260621-19:07:38 (UTC+8)260621-19:07:39 (UTC+8)
13615_UncertaintyWeightedAggregation Phase1 epoch=1300/2256 best=93.38@202 260621-19:07:10 (UTC+8)260621-19:07:11 (UTC+8)
13515_UncertaintyWeightedAggregation Phase1 epoch=1200/2256 best=93.38@202 260621-19:06:43 (UTC+8)260621-19:06:45 (UTC+8)
13415_UncertaintyWeightedAggregation Phase1 epoch=1100/2256 best=93.38@202 260621-19:06:17 (UTC+8)260621-19:06:18 (UTC+8)
13315_UncertaintyWeightedAggregation Phase1 epoch=1000/2256 best=93.38@202 260621-19:05:51 (UTC+8)260621-19:05:51 (UTC+8)
13215_UncertaintyWeightedAggregation Phase1 epoch=900/2256 best=93.38@202 260621-19:05:25 (UTC+8)260621-19:05:26 (UTC+8)
13115_UncertaintyWeightedAggregation Phase1 epoch=800/2256 best=93.38@202 260621-19:04:56 (UTC+8)260621-19:04:58 (UTC+8)
13015_UncertaintyWeightedAggregation Phase1 epoch=700/2256 best=93.38@202 260621-19:04:31 (UTC+8)260621-19:04:32 (UTC+8)
12915_UncertaintyWeightedAggregation Phase1 epoch=600/2256 best=93.38@202 260621-19:04:03 (UTC+8)260621-19:04:05 (UTC+8)
12815_UncertaintyWeightedAggregation Phase1 epoch=500/2256 best=93.38@202 260621-19:03:37 (UTC+8)260621-19:03:38 (UTC+8)
12715_UncertaintyWeightedAggregation Phase1 epoch=400/2256 best=93.38@202 260621-19:03:11 (UTC+8)260621-19:03:12 (UTC+8)
12615_UncertaintyWeightedAggregation Phase1 epoch=300/2256 best=93.38@202 260621-19:02:43 (UTC+8)260621-19:02:45 (UTC+8)
12515_UncertaintyWeightedAggregation Phase1 epoch=200/2256 best=93.36@194 260621-19:02:18 (UTC+8)260621-19:02:19 (UTC+8)
12415_UncertaintyWeightedAggregation Phase1 epoch=100/2256 best=93.18@92 260621-19:01:51 (UTC+8)260621-19:01:52 (UTC+8)
12315_UncertaintyWeightedAggregation Phase1 epoch=1/2256 best=39.79@1 260621-19:01:23 (UTC+8)260621-19:01:26 (UTC+8)
12215_UncertaintyWeightedAggregation Phase1 启动:Uncertainty-gated topology aggregation 260621-19:01:21 (UTC+8)260621-19:01:24 (UTC+8)
12115_UncertaintyWeightedAggregation 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-19:01:16 (UTC+8)260621-19:01:19 (UTC+8)
120start Poly_15_UncertaintyWeightedAggregation 260621-19:01:12 (UTC+8)260621-19:01:15 (UTC+8)
11914_KMLPSoftmaxAggregation Phase2 完成:Val=94.01 Test=93.91 best_epoch=925 260621-19:01:00 (UTC+8)260621-19:01:02 (UTC+8)
11814_KMLPSoftmaxAggregation Phase2 epoch=1400/1706 Val=92.82 Test=93.13 best=94.01@925 260621-19:00:41 (UTC+8)260621-19:00:42 (UTC+8)
11714_KMLPSoftmaxAggregation Phase2 epoch=1300/1706 Val=93.36 Test=93.61 best=94.01@925 260621-19:00:39 (UTC+8)260621-19:00:40 (UTC+8)
11614_KMLPSoftmaxAggregation Phase2 epoch=1200/1706 Val=93.38 Test=93.99 best=94.01@925 260621-19:00:36 (UTC+8)260621-19:00:37 (UTC+8)
11514_KMLPSoftmaxAggregation Phase2 epoch=1000/1706 Val=93.53 Test=93.94 best=94.01@925 260621-19:00:26 (UTC+8)260621-19:00:29 (UTC+8)
11414_KMLPSoftmaxAggregation Phase2 epoch=900/1706 Val=93.38 Test=93.86 best=93.74@790 260621-19:00:24 (UTC+8)260621-19:00:27 (UTC+8)
11314_KMLPSoftmaxAggregation Phase2 epoch=800/1706 Val=93.58 Test=93.99 best=93.74@790 260621-19:00:22 (UTC+8)260621-19:00:25 (UTC+8)
11214_KMLPSoftmaxAggregation Phase2 epoch=700/1706 Val=93.46 Test=93.81 best=93.71@610 260621-19:00:19 (UTC+8)260621-19:00:22 (UTC+8)
11114_KMLPSoftmaxAggregation Phase2 epoch=300/1706 Val=91.45 Test=91.48 best=91.96@275 260621-18:59:59 (UTC+8)260621-19:00:01 (UTC+8)
11014_KMLPSoftmaxAggregation Phase2 epoch=200/1706 Val=91.10 Test=90.80 best=91.10@200 260621-18:59:57 (UTC+8)260621-18:59:59 (UTC+8)
10914_KMLPSoftmaxAggregation Phase2 epoch=100/1706 Val=89.22 Test=89.63 best=89.22@100 260621-18:59:55 (UTC+8)260621-18:59:57 (UTC+8)
10814_KMLPSoftmaxAggregation Phase1 epoch=2000/2256 best=93.46@226 260621-18:58:30 (UTC+8)260621-18:58:34 (UTC+8)
10714_KMLPSoftmaxAggregation Phase1 epoch=1800/2256 best=93.46@226 260621-18:57:46 (UTC+8)260621-18:57:48 (UTC+8)
10614_KMLPSoftmaxAggregation Phase1 epoch=1700/2256 best=93.46@226 260621-18:57:25 (UTC+8)260621-18:57:26 (UTC+8)
10514_KMLPSoftmaxAggregation Phase1 epoch=1400/2256 best=93.46@226 260621-18:56:07 (UTC+8)260621-18:56:10 (UTC+8)
10414_KMLPSoftmaxAggregation Phase1 epoch=1100/2256 best=93.46@226 260621-18:54:39 (UTC+8)260621-18:54:40 (UTC+8)
10314_KMLPSoftmaxAggregation Phase1 epoch=1000/2256 best=93.46@226 260621-18:54:14 (UTC+8)260621-18:54:14 (UTC+8)
10214_KMLPSoftmaxAggregation Phase1 epoch=700/2256 best=93.46@226 260621-18:52:46 (UTC+8)260621-18:52:47 (UTC+8)
10114_KMLPSoftmaxAggregation Phase1 epoch=600/2256 best=93.46@226 260621-18:52:18 (UTC+8)260621-18:52:19 (UTC+8)
10014_KMLPSoftmaxAggregation Phase1 epoch=400/2256 best=93.46@226 260621-18:51:18 (UTC+8)260621-18:51:22 (UTC+8)
9914_KMLPSoftmaxAggregation Phase1 epoch=300/2256 best=93.46@226 260621-18:50:52 (UTC+8)260621-18:50:54 (UTC+8)
9814_KMLPSoftmaxAggregation Phase1 epoch=100/2256 best=93.15@92 260621-18:49:55 (UTC+8)260621-18:49:57 (UTC+8)
9714_KMLPSoftmaxAggregation Phase1 epoch=1/2256 best=39.79@1 260621-18:49:27 (UTC+8)260621-18:49:31 (UTC+8)
9614_KMLPSoftmaxAggregation Phase1 启动:K-dimension MLP softmax aggregation 260621-18:49:26 (UTC+8)260621-18:49:29 (UTC+8)
9514_KMLPSoftmaxAggregation 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-18:49:21 (UTC+8)260621-18:49:24 (UTC+8)
94start Poly_14_KMLPSoftmaxAggregation 260621-18:49:18 (UTC+8)260621-18:49:20 (UTC+8)
93done Poly_16_K2M2FullReplay 260621-18:49:16 (UTC+8)260621-18:49:19 (UTC+8)
9200_FullBestReplay Phase2 完成:Val=93.91 Test=93.08 best_epoch=1225 260621-18:49:10 (UTC+8)260621-18:49:12 (UTC+8)
9100_FullBestReplay Phase2 epoch=1600/1706 Val=92.62 Test=93.18 best=93.91@1225 260621-18:49:03 (UTC+8)260621-18:49:05 (UTC+8)
9000_FullBestReplay Phase2 epoch=1500/1706 Val=93.51 Test=93.33 best=93.91@1225 260621-18:49:00 (UTC+8)260621-18:49:03 (UTC+8)
8900_FullBestReplay Phase2 epoch=1400/1706 Val=93.36 Test=93.48 best=93.91@1225 260621-18:48:59 (UTC+8)260621-18:49:00 (UTC+8)
8800_FullBestReplay Phase2 epoch=1300/1706 Val=93.36 Test=92.90 best=93.91@1225 260621-18:48:57 (UTC+8)260621-18:48:59 (UTC+8)
8700_FullBestReplay Phase2 epoch=1200/1706 Val=93.53 Test=93.51 best=93.66@1180 260621-18:48:54 (UTC+8)260621-18:48:56 (UTC+8)
8600_FullBestReplay Phase2 epoch=1100/1706 Val=93.23 Test=93.00 best=93.63@770 260621-18:48:52 (UTC+8)260621-18:48:54 (UTC+8)
8500_FullBestReplay Phase2 epoch=1000/1706 Val=93.20 Test=93.66 best=93.63@770 260621-18:48:50 (UTC+8)260621-18:48:52 (UTC+8)
8400_FullBestReplay Phase2 epoch=900/1706 Val=93.08 Test=93.53 best=93.63@770 260621-18:48:49 (UTC+8)260621-18:48:50 (UTC+8)
8300_FullBestReplay Phase2 epoch=800/1706 Val=92.97 Test=93.48 best=93.63@770 260621-18:48:46 (UTC+8)260621-18:48:48 (UTC+8)
8200_FullBestReplay Phase2 epoch=700/1706 Val=92.54 Test=93.41 best=93.38@665 260621-18:48:44 (UTC+8)260621-18:48:46 (UTC+8)
8100_FullBestReplay Phase2 epoch=500/1706 Val=92.42 Test=92.82 best=92.97@460 260621-18:48:36 (UTC+8)260621-18:48:37 (UTC+8)
8000_FullBestReplay Phase2 epoch=400/1706 Val=92.77 Test=92.17 best=92.77@385 260621-18:48:34 (UTC+8)260621-18:48:35 (UTC+8)
7900_FullBestReplay Phase2 epoch=300/1706 Val=92.06 Test=91.58 best=92.32@290 260621-18:48:32 (UTC+8)260621-18:48:33 (UTC+8)
7800_FullBestReplay Phase2 epoch=200/1706 Val=90.57 Test=90.90 best=90.72@190 260621-18:48:29 (UTC+8)260621-18:48:30 (UTC+8)
7700_FullBestReplay Phase2 epoch=100/1706 Val=89.50 Test=89.38 best=89.50@100 260621-18:48:27 (UTC+8)260621-18:48:28 (UTC+8)
7600_FullBestReplay Phase2 epoch=1/1706 Val=20.52 Test=20.69 best=20.52@1 260621-18:48:25 (UTC+8)260621-18:48:26 (UTC+8)
7500_FullBestReplay Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-18:48:23 (UTC+8)260621-18:48:25 (UTC+8)
7400_FullBestReplay Phase1 完成:best=93.41@224 targets=19717 260621-18:48:20 (UTC+8)260621-18:48:22 (UTC+8)
7300_FullBestReplay Phase1 epoch=2200/2256 best=93.41@224 260621-18:48:09 (UTC+8)260621-18:48:10 (UTC+8)
7200_FullBestReplay Phase1 epoch=2100/2256 best=93.41@224 260621-18:47:46 (UTC+8)260621-18:47:49 (UTC+8)
7100_FullBestReplay Phase1 epoch=2000/2256 best=93.41@224 260621-18:47:26 (UTC+8)260621-18:47:28 (UTC+8)
7000_FullBestReplay Phase1 epoch=1900/2256 best=93.41@224 260621-18:47:06 (UTC+8)260621-18:47:07 (UTC+8)
6900_FullBestReplay Phase1 epoch=1800/2256 best=93.41@224 260621-18:46:45 (UTC+8)260621-18:46:46 (UTC+8)
6800_FullBestReplay Phase1 epoch=1700/2256 best=93.41@224 260621-18:46:22 (UTC+8)260621-18:46:24 (UTC+8)
6700_FullBestReplay Phase1 epoch=1600/2256 best=93.41@224 260621-18:46:02 (UTC+8)260621-18:46:03 (UTC+8)
6600_FullBestReplay Phase1 epoch=1500/2256 best=93.41@224 260621-18:45:42 (UTC+8)260621-18:45:43 (UTC+8)
6500_FullBestReplay Phase1 epoch=1400/2256 best=93.41@224 260621-18:45:16 (UTC+8)260621-18:45:17 (UTC+8)
6400_FullBestReplay Phase1 epoch=1300/2256 best=93.41@224 260621-18:44:48 (UTC+8)260621-18:44:49 (UTC+8)
6300_FullBestReplay Phase1 epoch=1200/2256 best=93.41@224 260621-18:44:21 (UTC+8)260621-18:44:24 (UTC+8)
6200_FullBestReplay Phase1 epoch=1100/2256 best=93.41@224 260621-18:43:55 (UTC+8)260621-18:43:56 (UTC+8)
6100_FullBestReplay Phase1 epoch=1000/2256 best=93.41@224 260621-18:43:28 (UTC+8)260621-18:43:30 (UTC+8)
6000_FullBestReplay Phase1 epoch=900/2256 best=93.41@224 260621-18:43:03 (UTC+8)260621-18:43:04 (UTC+8)
5900_FullBestReplay Phase1 epoch=800/2256 best=93.41@224 260621-18:42:35 (UTC+8)260621-18:42:37 (UTC+8)
5800_FullBestReplay Phase1 epoch=700/2256 best=93.41@224 260621-18:42:08 (UTC+8)260621-18:42:10 (UTC+8)
5700_FullBestReplay Phase1 epoch=600/2256 best=93.41@224 260621-18:41:43 (UTC+8)260621-18:41:43 (UTC+8)
5600_FullBestReplay Phase1 epoch=500/2256 best=93.41@224 260621-18:41:15 (UTC+8)260621-18:41:16 (UTC+8)
5500_FullBestReplay Phase1 epoch=400/2256 best=93.41@224 260621-18:40:49 (UTC+8)260621-18:40:51 (UTC+8)
5400_FullBestReplay Phase1 epoch=300/2256 best=93.41@224 260621-18:40:21 (UTC+8)260621-18:40:24 (UTC+8)
5300_FullBestReplay Phase1 epoch=200/2256 best=93.36@191 260621-18:39:56 (UTC+8)260621-18:39:57 (UTC+8)
5200_FullBestReplay Phase1 epoch=100/2256 best=93.15@92 260621-18:39:25 (UTC+8)260621-18:39:30 (UTC+8)
5100_FullBestReplay Phase1 启动:Full latest PubMed replay 260621-18:38:54 (UTC+8)260621-18:38:59 (UTC+8)
5000_FullBestReplay 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-18:38:49 (UTC+8)260621-18:38:53 (UTC+8)
49start Poly_16_K2M2FullReplay 260621-18:38:46 (UTC+8)260621-18:38:49 (UTC+8)
48P4 K2M2 extracting:batch=41704/41704 prompts=41704/41704 260621-18:38:28 (UTC+8)260621-18:38:32 (UTC+8)
47P4 K2M2 extracting:batch=41000/41704 prompts=41000/41704 260621-18:36:03 (UTC+8)260621-18:36:04 (UTC+8)
46P4 K2M2 extracting:batch=40000/41704 prompts=40000/41704 260621-18:32:34 (UTC+8)260621-18:32:36 (UTC+8)
45P4 K2M2 extracting:batch=39000/41704 prompts=39000/41704 260621-18:29:12 (UTC+8)260621-18:29:13 (UTC+8)
44P4 K2M2 extracting:batch=38000/41704 prompts=38000/41704 260621-18:25:45 (UTC+8)260621-18:25:47 (UTC+8)
43P4 K2M2 extracting:batch=37000/41704 prompts=37000/41704 260621-18:22:23 (UTC+8)260621-18:22:24 (UTC+8)
42P4 K2M2 extracting:batch=36000/41704 prompts=36000/41704 260621-18:18:56 (UTC+8)260621-18:18:59 (UTC+8)
41P4 K2M2 extracting:batch=35000/41704 prompts=35000/41704 260621-18:15:32 (UTC+8)260621-18:15:34 (UTC+8)
40P4 K2M2 extracting:batch=34000/41704 prompts=34000/41704 260621-18:12:03 (UTC+8)260621-18:12:05 (UTC+8)
39P4 K2M2 extracting:batch=33000/41704 prompts=33000/41704 260621-18:08:34 (UTC+8)260621-18:08:36 (UTC+8)
38P4 K2M2 extracting:batch=32000/41704 prompts=32000/41704 260621-18:05:05 (UTC+8)260621-18:05:06 (UTC+8)
37P4 K2M2 extracting:batch=31000/41704 prompts=31000/41704 260621-18:01:40 (UTC+8)260621-18:01:41 (UTC+8)
36P4 K2M2 extracting:batch=30000/41704 prompts=30000/41704 260621-17:58:11 (UTC+8)260621-17:58:12 (UTC+8)
35P4 K2M2 extracting:batch=29000/41704 prompts=29000/41704 260621-17:54:44 (UTC+8)260621-17:54:46 (UTC+8)
34P4 K2M2 extracting:batch=28000/41704 prompts=28000/41704 260621-17:51:17 (UTC+8)260621-17:51:18 (UTC+8)
33P4 K2M2 extracting:batch=27000/41704 prompts=27000/41704 260621-17:47:56 (UTC+8)260621-17:47:57 (UTC+8)
32P4 K2M2 extracting:batch=26000/41704 prompts=26000/41704 260621-17:44:29 (UTC+8)260621-17:44:30 (UTC+8)
31P4 K2M2 extracting:batch=25000/41704 prompts=25000/41704 260621-17:41:01 (UTC+8)260621-17:41:02 (UTC+8)
30P4 K2M2 extracting:batch=24000/41704 prompts=24000/41704 260621-17:37:27 (UTC+8)260621-17:37:29 (UTC+8)
29P4 K2M2 extracting:batch=23000/41704 prompts=23000/41704 260621-17:33:53 (UTC+8)260621-17:33:55 (UTC+8)
28P4 K2M2 extracting:batch=21000/41704 prompts=21000/41704 260621-17:27:02 (UTC+8)260621-17:27:04 (UTC+8)
27P4 K2M2 extracting:batch=20000/41704 prompts=20000/41704 260621-17:23:28 (UTC+8)260621-17:23:29 (UTC+8)
26P4 K2M2 extracting:batch=19000/41704 prompts=19000/41704 260621-17:20:01 (UTC+8)260621-17:20:03 (UTC+8)
25P4 K2M2 extracting:batch=18000/41704 prompts=18000/41704 260621-17:16:35 (UTC+8)260621-17:16:36 (UTC+8)
24P4 K2M2 extracting:batch=17000/41704 prompts=17000/41704 260621-17:13:09 (UTC+8)260621-17:13:11 (UTC+8)
23P4 K2M2 extracting:batch=16000/41704 prompts=16000/41704 260621-17:09:45 (UTC+8)260621-17:09:47 (UTC+8)
22P4 K2M2 extracting:batch=15000/41704 prompts=15000/41704 260621-17:06:19 (UTC+8)260621-17:06:20 (UTC+8)
21P4 K2M2 extracting:batch=14000/41704 prompts=14000/41704 260621-17:02:48 (UTC+8)260621-17:02:50 (UTC+8)
20P4 K2M2 extracting:batch=13000/41704 prompts=13000/41704 260621-16:59:21 (UTC+8)260621-16:59:22 (UTC+8)
19P4 K2M2 extracting:batch=12000/41704 prompts=12000/41704 260621-16:56:02 (UTC+8)260621-16:56:04 (UTC+8)
18P4 K2M2 extracting:batch=11000/41704 prompts=11000/41704 260621-16:52:36 (UTC+8)260621-16:52:38 (UTC+8)
17P4 K2M2 extracting:batch=10000/41704 prompts=10000/41704 260621-16:49:08 (UTC+8)260621-16:49:10 (UTC+8)
16P4 K2M2 extracting:batch=9000/41704 prompts=9000/41704 260621-16:45:41 (UTC+8)260621-16:45:45 (UTC+8)
15P4 K2M2 extracting:batch=8000/41704 prompts=8000/41704 260621-16:42:20 (UTC+8)260621-16:42:21 (UTC+8)
14P4 K2M2 extracting:batch=7000/41704 prompts=7000/41704 260621-16:38:52 (UTC+8)260621-16:38:54 (UTC+8)
13P4 K2M2 extracting:batch=6000/41704 prompts=6000/41704 260621-16:35:25 (UTC+8)260621-16:35:27 (UTC+8)
12P4 K2M2 extracting:batch=5000/41704 prompts=5000/41704 260621-16:31:57 (UTC+8)260621-16:31:59 (UTC+8)
11P4 K2M2 extracting:batch=4000/41704 prompts=4000/41704 260621-16:28:32 (UTC+8)260621-16:28:34 (UTC+8)
10P4 K2M2 extracting:batch=3000/41704 prompts=3000/41704 260621-16:23:38 (UTC+8)260621-16:25:05 (UTC+8)
9P4 K2M2 extracting:batch=2000/41704 prompts=2000/41704 260621-16:20:16 (UTC+8)260621-16:21:35 (UTC+8)
8P4 K2M2 extracting:batch=1000/41704 prompts=1000/41704 260621-16:17:00 (UTC+8)260621-16:18:10 (UTC+8)
7P4 K2M2 extracting:batch=1/41704 prompts=1/41704 260621-16:13:43 (UTC+8)260621-16:14:45 (UTC+8)
6P4 K2M2 model loaded:layer=21/32 hidden=4096 260621-16:13:38 (UTC+8)260621-16:14:40 (UTC+8)
5P4 K2M2 plan ready:prompts=41704 nodes=19717 260621-16:13:30 (UTC+8)260621-16:14:32 (UTC+8)
4P4 K2M2 bank 启动:root=/media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Pubmed_6666 output=/media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Pubmed_6666/embedding_bank batch=1 260621-16:13:26 (UTC+8)260621-16:14:27 (UTC+8)
3start P4_K2M2_bank_batch1_seed6666 260621-16:13:06 (UTC+8)260621-16:14:22 (UTC+8)
2start Unit_SFT_LoRA_seed6666_resume7166 260621-09:25:08 (UTC+8)260621-09:25:10 (UTC+8)
1resume run 已启动:从 checkpoint-7166 接续,cuda0 260621-09:25:08 (UTC+8)260621-09:25:09 (UTC+8)
#03

PubMed9999RemainingAblations

▦ table
last update
260621-15:45:43
records
390
type
text
latest
13_OnlyInvForce Phase1 epoch=1100/2256 best=40.02@2 260621-15:45:36 (UTC+8)
ID数值接收时间
39013_OnlyInvForce Phase1 epoch=1100/2256 best=40.02@2 260621-15:45:36 (UTC+8)260621-15:45:43 (UTC+8)
38913_OnlyInvForce Phase1 epoch=1000/2256 best=40.02@2 260621-15:44:50 (UTC+8)260621-15:44:58 (UTC+8)
38813_OnlyInvForce Phase1 epoch=600/2256 best=40.02@2 260621-15:41:14 (UTC+8)260621-15:41:27 (UTC+8)
38713_OnlyInvForce Phase1 epoch=300/2256 best=40.02@2 260621-15:38:55 (UTC+8)260621-15:39:02 (UTC+8)
38613_OnlyInvForce Phase1 启动:Three-force ablation: invariance only 260621-15:36:23 (UTC+8)260621-15:36:23 (UTC+8)
38513_OnlyInvForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-15:36:16 (UTC+8)260621-15:36:17 (UTC+8)
38412_OnlyIBForce 完成:Val=90.11 Test=89.83 MLP=88.21 GNN=89.20 260621-15:36:12 (UTC+8)260621-15:36:12 (UTC+8)
38312_OnlyIBForce Phase2 完成:Val=90.11 Test=89.83 best_epoch=720 260621-15:36:09 (UTC+8)260621-15:36:12 (UTC+8)
38212_OnlyIBForce Phase2 epoch=1600/1706 Val=88.89 Test=88.51 best=90.11@720 260621-15:35:52 (UTC+8)260621-15:36:01 (UTC+8)
38112_OnlyIBForce Phase2 epoch=1400/1706 Val=89.60 Test=89.05 best=90.11@720 260621-15:35:36 (UTC+8)260621-15:35:37 (UTC+8)
38012_OnlyIBForce Phase2 epoch=1200/1706 Val=89.17 Test=88.72 best=90.11@720 260621-15:35:18 (UTC+8)260621-15:35:20 (UTC+8)
37912_OnlyIBForce Phase2 epoch=900/1706 Val=89.70 Test=89.45 best=90.11@720 260621-15:34:51 (UTC+8)260621-15:34:51 (UTC+8)
37812_OnlyIBForce Phase2 epoch=800/1706 Val=89.60 Test=89.71 best=90.11@720 260621-15:34:44 (UTC+8)260621-15:34:45 (UTC+8)
37712_OnlyIBForce Phase2 epoch=700/1706 Val=89.98 Test=89.73 best=89.98@595 260621-15:34:38 (UTC+8)260621-15:34:39 (UTC+8)
37612_OnlyIBForce Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-15:33:19 (UTC+8)260621-15:33:21 (UTC+8)
37512_OnlyIBForce Phase1 完成:best=40.43@26 targets=19717 260621-15:32:59 (UTC+8)260621-15:33:00 (UTC+8)
37412_OnlyIBForce Phase1 epoch=2200/2256 best=40.43@26 260621-15:32:40 (UTC+8)260621-15:32:41 (UTC+8)
37312_OnlyIBForce Phase1 epoch=2000/2256 best=40.43@26 260621-15:31:16 (UTC+8)260621-15:31:22 (UTC+8)
37212_OnlyIBForce Phase1 epoch=1800/2256 best=40.43@26 260621-15:30:05 (UTC+8)260621-15:30:09 (UTC+8)
37112_OnlyIBForce Phase1 epoch=1700/2256 best=40.43@26 260621-15:29:30 (UTC+8)260621-15:29:34 (UTC+8)
37012_OnlyIBForce Phase1 epoch=1600/2256 best=40.43@26 260621-15:28:57 (UTC+8)260621-15:28:58 (UTC+8)
36912_OnlyIBForce Phase1 epoch=1500/2256 best=40.43@26 260621-15:28:22 (UTC+8)260621-15:28:23 (UTC+8)
36812_OnlyIBForce Phase1 epoch=1000/2256 best=40.43@26 260621-15:24:16 (UTC+8)260621-15:24:17 (UTC+8)
36712_OnlyIBForce Phase1 epoch=800/2256 best=40.43@26 260621-15:22:43 (UTC+8)260621-15:22:43 (UTC+8)
36612_OnlyIBForce Phase1 epoch=600/2256 best=40.43@26 260621-15:21:04 (UTC+8)260621-15:21:10 (UTC+8)
36512_OnlyIBForce Phase1 epoch=100/2256 best=40.43@26 260621-15:17:03 (UTC+8)260621-15:17:08 (UTC+8)
36412_OnlyIBForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-15:16:06 (UTC+8)260621-15:16:09 (UTC+8)
36311_OnlyPredForce Phase2 epoch=1700/1706 Val=93.66 Test=91.99 best=94.14@1265 260621-15:15:50 (UTC+8)260621-15:15:53 (UTC+8)
36211_OnlyPredForce Phase2 epoch=1600/1706 Val=93.28 Test=92.09 best=94.14@1265 260621-15:15:44 (UTC+8)260621-15:15:46 (UTC+8)
36111_OnlyPredForce Phase2 epoch=1300/1706 Val=93.66 Test=92.57 best=94.14@1265 260621-15:15:17 (UTC+8)260621-15:15:18 (UTC+8)
36011_OnlyPredForce Phase2 epoch=1200/1706 Val=93.36 Test=91.86 best=94.07@665 260621-15:15:11 (UTC+8)260621-15:15:12 (UTC+8)
35911_OnlyPredForce Phase2 epoch=900/1706 Val=93.61 Test=92.42 best=94.07@665 260621-15:14:43 (UTC+8)260621-15:14:43 (UTC+8)
35811_OnlyPredForce Phase2 epoch=800/1706 Val=93.94 Test=92.88 best=94.07@665 260621-15:14:36 (UTC+8)260621-15:14:37 (UTC+8)
35711_OnlyPredForce Phase2 epoch=300/1706 Val=93.23 Test=92.67 best=93.63@295 260621-15:13:43 (UTC+8)260621-15:13:48 (UTC+8)
35611_OnlyPredForce Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-15:13:16 (UTC+8)260621-15:13:20 (UTC+8)
35511_OnlyPredForce Phase1 完成:best=93.71@405 targets=19717 260621-15:12:56 (UTC+8)260621-15:12:59 (UTC+8)
35411_OnlyPredForce Phase1 epoch=2100/2256 best=93.71@405 260621-15:11:54 (UTC+8)260621-15:11:57 (UTC+8)
35311_OnlyPredForce Phase1 epoch=2000/2256 best=93.71@405 260621-15:11:21 (UTC+8)260621-15:11:22 (UTC+8)
35211_OnlyPredForce Phase1 epoch=1900/2256 best=93.71@405 260621-15:10:47 (UTC+8)260621-15:10:48 (UTC+8)
35111_OnlyPredForce Phase1 epoch=1700/2256 best=93.71@405 260621-15:09:29 (UTC+8)260621-15:09:33 (UTC+8)
35011_OnlyPredForce Phase1 epoch=1400/2256 best=93.71@405 260621-15:07:21 (UTC+8)260621-15:07:26 (UTC+8)
34911_OnlyPredForce Phase1 epoch=1100/2256 best=93.71@405 260621-15:04:57 (UTC+8)260621-15:05:00 (UTC+8)
34811_OnlyPredForce Phase1 epoch=900/2256 best=93.71@405 260621-15:03:20 (UTC+8)260621-15:03:23 (UTC+8)
34711_OnlyPredForce Phase1 epoch=500/2256 best=93.71@405 260621-14:59:56 (UTC+8)260621-15:00:03 (UTC+8)
34611_OnlyPredForce Phase1 epoch=400/2256 best=93.66@15 260621-14:59:12 (UTC+8)260621-14:59:18 (UTC+8)
34511_OnlyPredForce Phase1 epoch=300/2256 best=93.66@15 260621-14:58:28 (UTC+8)260621-14:58:31 (UTC+8)
34411_OnlyPredForce Phase1 epoch=200/2256 best=93.66@15 260621-14:57:43 (UTC+8)260621-14:57:44 (UTC+8)
34311_OnlyPredForce Phase1 epoch=1/2256 best=39.67@1 260621-14:56:01 (UTC+8)260621-14:56:09 (UTC+8)
34211_OnlyPredForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-14:55:50 (UTC+8)260621-14:55:58 (UTC+8)
34110_NoInvForce Phase2 完成:Val=94.22 Test=93.13 best_epoch=1195 260621-14:55:40 (UTC+8)260621-14:55:48 (UTC+8)
34010_NoInvForce Phase2 epoch=1600/1706 Val=93.53 Test=92.57 best=94.22@1195 260621-14:55:28 (UTC+8)260621-14:55:36 (UTC+8)
33910_NoInvForce Phase2 epoch=1500/1706 Val=93.69 Test=92.67 best=94.22@1195 260621-14:55:22 (UTC+8)260621-14:55:29 (UTC+8)
33810_NoInvForce Phase2 epoch=800/1706 Val=93.36 Test=91.99 best=93.63@705 260621-14:54:13 (UTC+8)260621-14:54:17 (UTC+8)
33710_NoInvForce Phase2 epoch=500/1706 Val=93.08 Test=92.49 best=93.23@480 260621-14:53:46 (UTC+8)260621-14:53:49 (UTC+8)
33610_NoInvForce Phase2 epoch=100/1706 Val=89.53 Test=89.66 best=89.53@100 260621-14:53:08 (UTC+8)260621-14:53:10 (UTC+8)
33510_NoInvForce Phase1 完成:best=93.89@296 targets=19717 260621-14:52:34 (UTC+8)260621-14:52:39 (UTC+8)
33410_NoInvForce Phase1 epoch=2100/2256 best=93.89@296 260621-14:51:35 (UTC+8)260621-14:51:37 (UTC+8)
33310_NoInvForce Phase1 epoch=1800/2256 best=93.89@296 260621-14:49:35 (UTC+8)260621-14:49:40 (UTC+8)
33210_NoInvForce Phase1 epoch=1600/2256 best=93.89@296 260621-14:48:22 (UTC+8)260621-14:48:24 (UTC+8)
33110_NoInvForce Phase1 epoch=1400/2256 best=93.89@296 260621-14:46:58 (UTC+8)260621-14:47:00 (UTC+8)
33010_NoInvForce Phase1 epoch=900/2256 best=93.89@296 260621-14:42:48 (UTC+8)260621-14:42:52 (UTC+8)
32910_NoInvForce Phase1 epoch=800/2256 best=93.89@296 260621-14:42:04 (UTC+8)260621-14:42:06 (UTC+8)
32810_NoInvForce Phase1 epoch=700/2256 best=93.89@296 260621-14:41:17 (UTC+8)260621-14:41:19 (UTC+8)
32710_NoInvForce Phase1 epoch=600/2256 best=93.89@296 260621-14:40:28 (UTC+8)260621-14:40:31 (UTC+8)
32610_NoInvForce Phase1 epoch=500/2256 best=93.89@296 260621-14:39:43 (UTC+8)260621-14:39:44 (UTC+8)
32510_NoInvForce Phase1 epoch=400/2256 best=93.89@296 260621-14:38:55 (UTC+8)260621-14:38:57 (UTC+8)
32410_NoInvForce Phase1 epoch=200/2256 best=93.66@16 260621-14:37:15 (UTC+8)260621-14:37:19 (UTC+8)
32310_NoInvForce Phase1 启动:Three-force ablation: no invariance force 260621-14:35:35 (UTC+8)260621-14:35:36 (UTC+8)
32210_NoInvForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-14:35:30 (UTC+8)260621-14:35:31 (UTC+8)
32109_NoIBForce Phase2 epoch=1600/1706 Val=94.19 Test=92.72 best=94.19@1600 260621-14:35:04 (UTC+8)260621-14:35:05 (UTC+8)
32009_NoIBForce Phase2 epoch=1500/1706 Val=93.74 Test=92.70 best=94.09@1450 260621-14:34:57 (UTC+8)260621-14:34:59 (UTC+8)
31909_NoIBForce Phase2 epoch=1400/1706 Val=93.71 Test=92.98 best=94.01@1375 260621-14:34:51 (UTC+8)260621-14:34:52 (UTC+8)
31809_NoIBForce Phase2 epoch=1300/1706 Val=92.32 Test=91.40 best=93.96@970 260621-14:34:45 (UTC+8)260621-14:34:46 (UTC+8)
31709_NoIBForce Phase2 epoch=1200/1706 Val=93.56 Test=93.15 best=93.96@970 260621-14:34:38 (UTC+8)260621-14:34:39 (UTC+8)
31609_NoIBForce Phase2 epoch=600/1706 Val=93.18 Test=92.98 best=93.48@565 260621-14:33:37 (UTC+8)260621-14:33:38 (UTC+8)
31509_NoIBForce Phase2 epoch=400/1706 Val=92.57 Test=92.44 best=92.65@380 260621-14:33:20 (UTC+8)260621-14:33:21 (UTC+8)
31409_NoIBForce Phase2 epoch=200/1706 Val=90.74 Test=91.58 best=90.97@190 260621-14:33:03 (UTC+8)260621-14:33:04 (UTC+8)
31309_NoIBForce Phase2 epoch=100/1706 Val=89.86 Test=89.55 best=89.86@100 260621-14:32:58 (UTC+8)260621-14:32:58 (UTC+8)
31209_NoIBForce Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-14:32:49 (UTC+8)260621-14:32:52 (UTC+8)
31109_NoIBForce Phase1 完成:best=94.12@138 targets=19717 260621-14:32:30 (UTC+8)260621-14:32:32 (UTC+8)
31009_NoIBForce Phase1 epoch=1900/2256 best=94.12@138 260621-14:30:10 (UTC+8)260621-14:30:12 (UTC+8)
30909_NoIBForce Phase1 epoch=1700/2256 best=94.12@138 260621-14:28:49 (UTC+8)260621-14:28:54 (UTC+8)
30809_NoIBForce Phase1 epoch=1500/2256 best=94.12@138 260621-14:27:38 (UTC+8)260621-14:27:41 (UTC+8)
30709_NoIBForce Phase1 epoch=1300/2256 best=94.12@138 260621-14:26:01 (UTC+8)260621-14:26:03 (UTC+8)
30609_NoIBForce Phase1 epoch=1200/2256 best=94.12@138 260621-14:25:07 (UTC+8)260621-14:25:17 (UTC+8)
30509_NoIBForce Phase1 epoch=1100/2256 best=94.12@138 260621-14:24:24 (UTC+8)260621-14:24:31 (UTC+8)
30409_NoIBForce Phase1 epoch=1000/2256 best=94.12@138 260621-14:23:37 (UTC+8)260621-14:23:43 (UTC+8)
30309_NoIBForce Phase1 epoch=900/2256 best=94.12@138 260621-14:22:53 (UTC+8)260621-14:22:57 (UTC+8)
30209_NoIBForce Phase1 epoch=700/2256 best=94.12@138 260621-14:21:17 (UTC+8)260621-14:21:20 (UTC+8)
30109_NoIBForce Phase1 epoch=400/2256 best=94.12@138 260621-14:18:51 (UTC+8)260621-14:18:51 (UTC+8)
30009_NoIBForce Phase1 epoch=300/2256 best=94.12@138 260621-14:18:04 (UTC+8)260621-14:18:05 (UTC+8)
29909_NoIBForce Phase1 epoch=1/2256 best=39.67@1 260621-14:15:38 (UTC+8)260621-14:15:39 (UTC+8)
29809_NoIBForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-14:15:24 (UTC+8)260621-14:15:27 (UTC+8)
29708_NoPredForce Phase2 epoch=1500/1706 Val=88.76 Test=88.62 best=90.39@1030 260621-14:14:49 (UTC+8)260621-14:14:50 (UTC+8)
29608_NoPredForce Phase2 epoch=1300/1706 Val=89.25 Test=89.38 best=90.39@1030 260621-14:14:28 (UTC+8)260621-14:14:33 (UTC+8)
29508_NoPredForce Phase2 epoch=1000/1706 Val=89.65 Test=89.27 best=90.26@820 260621-14:14:00 (UTC+8)260621-14:14:05 (UTC+8)
29408_NoPredForce Phase2 epoch=900/1706 Val=85.70 Test=85.75 best=90.26@820 260621-14:13:55 (UTC+8)260621-14:13:58 (UTC+8)
29308_NoPredForce Phase2 epoch=700/1706 Val=89.48 Test=89.15 best=90.06@545 260621-14:13:38 (UTC+8)260621-14:13:42 (UTC+8)
29208_NoPredForce Phase2 epoch=600/1706 Val=89.83 Test=89.76 best=90.06@545 260621-14:13:32 (UTC+8)260621-14:13:35 (UTC+8)
29108_NoPredForce Phase2 epoch=500/1706 Val=89.70 Test=89.76 best=89.91@490 260621-14:13:26 (UTC+8)260621-14:13:29 (UTC+8)
29008_NoPredForce Phase1 完成:best=39.97@10 targets=19717 260621-14:12:10 (UTC+8)260621-14:12:14 (UTC+8)
28908_NoPredForce Phase1 epoch=2200/2256 best=39.97@10 260621-14:11:52 (UTC+8)260621-14:11:55 (UTC+8)
28808_NoPredForce Phase1 epoch=2100/2256 best=39.97@10 260621-14:11:19 (UTC+8)260621-14:11:20 (UTC+8)
28708_NoPredForce Phase1 epoch=1400/2256 best=39.97@10 260621-14:06:38 (UTC+8)260621-14:06:43 (UTC+8)
28608_NoPredForce Phase1 epoch=1300/2256 best=39.97@10 260621-14:05:53 (UTC+8)260621-14:05:57 (UTC+8)
28508_NoPredForce Phase1 epoch=1200/2256 best=39.97@10 260621-14:05:09 (UTC+8)260621-14:05:11 (UTC+8)
28408_NoPredForce Phase1 epoch=1000/2256 best=39.97@10 260621-14:03:36 (UTC+8)260621-14:03:37 (UTC+8)
28308_NoPredForce Phase1 epoch=900/2256 best=39.97@10 260621-14:02:51 (UTC+8)260621-14:02:52 (UTC+8)
28208_NoPredForce Phase1 epoch=800/2256 best=39.97@10 260621-14:02:03 (UTC+8)260621-14:02:06 (UTC+8)
28108_NoPredForce Phase1 epoch=700/2256 best=39.97@10 260621-14:01:18 (UTC+8)260621-14:01:20 (UTC+8)
28008_NoPredForce Phase1 epoch=600/2256 best=39.97@10 260621-14:00:34 (UTC+8)260621-14:00:36 (UTC+8)
27908_NoPredForce Phase1 epoch=500/2256 best=39.97@10 260621-13:59:49 (UTC+8)260621-13:59:52 (UTC+8)
27808_NoPredForce Phase1 epoch=400/2256 best=39.97@10 260621-13:59:05 (UTC+8)260621-13:59:07 (UTC+8)
27708_NoPredForce Phase1 epoch=300/2256 best=39.97@10 260621-13:58:22 (UTC+8)260621-13:58:23 (UTC+8)
27608_NoPredForce Phase1 epoch=200/2256 best=39.97@10 260621-13:57:38 (UTC+8)260621-13:57:39 (UTC+8)
27508_NoPredForce Phase1 epoch=100/2256 best=39.97@10 260621-13:56:51 (UTC+8)260621-13:56:53 (UTC+8)
27408_NoPredForce Phase1 epoch=1/2256 best=39.31@1 260621-13:56:07 (UTC+8)260621-13:56:09 (UTC+8)
27308_NoPredForce Phase1 启动:Three-force ablation: no prediction force 260621-13:56:05 (UTC+8)260621-13:56:07 (UTC+8)
27208_NoPredForce 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-13:56:00 (UTC+8)260621-13:56:01 (UTC+8)
27107_StudentTargetMismatch 完成:Val=93.94 Test=92.75 MLP=92.67 GNN=90.34 260621-13:55:56 (UTC+8)260621-13:55:57 (UTC+8)
27007_StudentTargetMismatch Phase2 完成:Val=93.94 Test=92.75 best_epoch=710 260621-13:55:55 (UTC+8)260621-13:55:56 (UTC+8)
26907_StudentTargetMismatch Phase2 epoch=1700/1706 Val=93.53 Test=92.32 best=93.94@710 260621-13:55:53 (UTC+8)260621-13:55:54 (UTC+8)
26807_StudentTargetMismatch Phase2 epoch=1600/1706 Val=93.58 Test=92.29 best=93.94@710 260621-13:55:46 (UTC+8)260621-13:55:48 (UTC+8)
26707_StudentTargetMismatch Phase2 epoch=1500/1706 Val=93.51 Test=92.32 best=93.94@710 260621-13:55:40 (UTC+8)260621-13:55:41 (UTC+8)
26607_StudentTargetMismatch Phase2 epoch=1400/1706 Val=93.46 Test=92.47 best=93.94@710 260621-13:55:34 (UTC+8)260621-13:55:35 (UTC+8)
26507_StudentTargetMismatch Phase2 epoch=1300/1706 Val=93.69 Test=92.24 best=93.94@710 260621-13:55:28 (UTC+8)260621-13:55:29 (UTC+8)
26407_StudentTargetMismatch Phase2 epoch=1200/1706 Val=93.69 Test=92.67 best=93.94@710 260621-13:55:21 (UTC+8)260621-13:55:22 (UTC+8)
26307_StudentTargetMismatch Phase2 epoch=1100/1706 Val=93.36 Test=92.49 best=93.94@710 260621-13:55:13 (UTC+8)260621-13:55:16 (UTC+8)
26207_StudentTargetMismatch Phase2 epoch=1000/1706 Val=93.66 Test=92.75 best=93.94@710 260621-13:55:08 (UTC+8)260621-13:55:09 (UTC+8)
26107_StudentTargetMismatch Phase2 epoch=900/1706 Val=93.46 Test=92.47 best=93.94@710 260621-13:55:01 (UTC+8)260621-13:55:03 (UTC+8)
26007_StudentTargetMismatch Phase2 epoch=800/1706 Val=93.63 Test=92.88 best=93.94@710 260621-13:54:55 (UTC+8)260621-13:54:56 (UTC+8)
25907_StudentTargetMismatch Phase2 epoch=700/1706 Val=93.56 Test=92.49 best=93.81@630 260621-13:54:48 (UTC+8)260621-13:54:49 (UTC+8)
25807_StudentTargetMismatch Phase2 epoch=600/1706 Val=93.56 Test=92.49 best=93.74@535 260621-13:54:42 (UTC+8)260621-13:54:43 (UTC+8)
25707_StudentTargetMismatch Phase2 epoch=500/1706 Val=93.20 Test=92.42 best=93.69@485 260621-13:54:34 (UTC+8)260621-13:54:36 (UTC+8)
25607_StudentTargetMismatch Phase2 epoch=400/1706 Val=93.38 Test=92.90 best=93.48@355 260621-13:54:28 (UTC+8)260621-13:54:29 (UTC+8)
25507_StudentTargetMismatch Phase2 epoch=300/1706 Val=92.54 Test=92.27 best=92.72@290 260621-13:54:22 (UTC+8)260621-13:54:23 (UTC+8)
25407_StudentTargetMismatch Phase2 epoch=200/1706 Val=91.71 Test=91.68 best=91.71@200 260621-13:54:15 (UTC+8)260621-13:54:16 (UTC+8)
25307_StudentTargetMismatch Phase2 epoch=100/1706 Val=90.11 Test=90.29 best=90.11@100 260621-13:54:09 (UTC+8)260621-13:54:09 (UTC+8)
25207_StudentTargetMismatch Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-13:54:01 (UTC+8)260621-13:54:03 (UTC+8)
25107_StudentTargetMismatch Phase1 完成:best=94.12@153 targets=19717 260621-13:53:41 (UTC+8)260621-13:53:42 (UTC+8)
25007_StudentTargetMismatch Phase1 epoch=2200/2256 best=94.12@153 260621-13:53:19 (UTC+8)260621-13:53:21 (UTC+8)
24907_StudentTargetMismatch Phase1 epoch=2100/2256 best=94.12@153 260621-13:52:42 (UTC+8)260621-13:52:44 (UTC+8)
24807_StudentTargetMismatch Phase1 epoch=2000/2256 best=94.12@153 260621-13:52:06 (UTC+8)260621-13:52:07 (UTC+8)
24707_StudentTargetMismatch Phase1 epoch=1900/2256 best=94.12@153 260621-13:51:29 (UTC+8)260621-13:51:30 (UTC+8)
24607_StudentTargetMismatch Phase1 epoch=1800/2256 best=94.12@153 260621-13:50:53 (UTC+8)260621-13:50:53 (UTC+8)
24507_StudentTargetMismatch Phase1 epoch=1700/2256 best=94.12@153 260621-13:50:16 (UTC+8)260621-13:50:17 (UTC+8)
24407_StudentTargetMismatch Phase1 epoch=1600/2256 best=94.12@153 260621-13:49:39 (UTC+8)260621-13:49:40 (UTC+8)
24307_StudentTargetMismatch Phase1 epoch=1500/2256 best=94.12@153 260621-13:49:03 (UTC+8)260621-13:49:04 (UTC+8)
24207_StudentTargetMismatch Phase1 epoch=1400/2256 best=94.12@153 260621-13:48:15 (UTC+8)260621-13:48:17 (UTC+8)
24107_StudentTargetMismatch Phase1 epoch=1300/2256 best=94.12@153 260621-13:47:29 (UTC+8)260621-13:47:30 (UTC+8)
24007_StudentTargetMismatch Phase1 epoch=1200/2256 best=94.12@153 260621-13:46:42 (UTC+8)260621-13:46:43 (UTC+8)
23907_StudentTargetMismatch Phase1 epoch=1100/2256 best=94.12@153 260621-13:45:53 (UTC+8)260621-13:45:55 (UTC+8)
23807_StudentTargetMismatch Phase1 epoch=1000/2256 best=94.12@153 260621-13:45:06 (UTC+8)260621-13:45:07 (UTC+8)
23707_StudentTargetMismatch Phase1 epoch=900/2256 best=94.12@153 260621-13:44:22 (UTC+8)260621-13:44:22 (UTC+8)
23607_StudentTargetMismatch Phase1 epoch=800/2256 best=94.12@153 260621-13:43:33 (UTC+8)260621-13:43:35 (UTC+8)
23507_StudentTargetMismatch Phase1 epoch=700/2256 best=94.12@153 260621-13:42:46 (UTC+8)260621-13:42:47 (UTC+8)
23407_StudentTargetMismatch Phase1 epoch=600/2256 best=94.12@153 260621-13:41:59 (UTC+8)260621-13:42:00 (UTC+8)
23307_StudentTargetMismatch Phase1 epoch=500/2256 best=94.12@153 260621-13:41:12 (UTC+8)260621-13:41:13 (UTC+8)
23207_StudentTargetMismatch Phase1 epoch=400/2256 best=94.12@153 260621-13:40:25 (UTC+8)260621-13:40:26 (UTC+8)
23107_StudentTargetMismatch Phase1 epoch=300/2256 best=94.12@153 260621-13:39:37 (UTC+8)260621-13:39:39 (UTC+8)
23007_StudentTargetMismatch Phase1 epoch=200/2256 best=94.12@153 260621-13:38:52 (UTC+8)260621-13:38:53 (UTC+8)
22907_StudentTargetMismatch Phase1 epoch=1/2256 best=39.67@1 260621-13:37:13 (UTC+8)260621-13:37:15 (UTC+8)
22807_StudentTargetMismatch Phase1 启动:Student-target mismatch 260621-13:37:12 (UTC+8)260621-13:37:13 (UTC+8)
22707_StudentTargetMismatch 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-13:37:07 (UTC+8)260621-13:37:08 (UTC+8)
22606_NoConditionalTopology 完成:Val=94.47 Test=93.28 MLP=90.95 GNN=91.53 260621-13:37:02 (UTC+8)260621-13:37:03 (UTC+8)
22506_NoConditionalTopology Phase2 完成:Val=94.47 Test=93.28 best_epoch=1670 260621-13:37:01 (UTC+8)260621-13:37:02 (UTC+8)
22406_NoConditionalTopology Phase2 epoch=1600/1706 Val=94.17 Test=93.13 best=94.42@1495 260621-13:36:48 (UTC+8)260621-13:36:50 (UTC+8)
22306_NoConditionalTopology Phase2 epoch=1500/1706 Val=94.19 Test=93.23 best=94.42@1495 260621-13:36:42 (UTC+8)260621-13:36:43 (UTC+8)
22206_NoConditionalTopology Phase2 epoch=1400/1706 Val=93.71 Test=92.67 best=94.12@990 260621-13:36:36 (UTC+8)260621-13:36:37 (UTC+8)
22106_NoConditionalTopology Phase2 epoch=1300/1706 Val=93.20 Test=93.10 best=94.12@990 260621-13:36:29 (UTC+8)260621-13:36:30 (UTC+8)
22006_NoConditionalTopology Phase2 epoch=1200/1706 Val=93.63 Test=92.98 best=94.12@990 260621-13:36:23 (UTC+8)260621-13:36:24 (UTC+8)
21906_NoConditionalTopology Phase2 epoch=1100/1706 Val=93.86 Test=92.98 best=94.12@990 260621-13:36:15 (UTC+8)260621-13:36:17 (UTC+8)
21806_NoConditionalTopology Phase2 epoch=1000/1706 Val=93.99 Test=92.60 best=94.12@990 260621-13:36:09 (UTC+8)260621-13:36:10 (UTC+8)
21706_NoConditionalTopology Phase2 epoch=900/1706 Val=93.53 Test=92.67 best=93.56@690 260621-13:36:02 (UTC+8)260621-13:36:03 (UTC+8)
21606_NoConditionalTopology Phase2 epoch=800/1706 Val=92.67 Test=92.55 best=93.56@690 260621-13:35:56 (UTC+8)260621-13:35:57 (UTC+8)
21506_NoConditionalTopology Phase2 epoch=700/1706 Val=93.03 Test=92.42 best=93.56@690 260621-13:35:50 (UTC+8)260621-13:35:50 (UTC+8)
21406_NoConditionalTopology Phase2 epoch=600/1706 Val=91.05 Test=90.67 best=93.28@550 260621-13:35:42 (UTC+8)260621-13:35:44 (UTC+8)
21306_NoConditionalTopology Phase2 epoch=500/1706 Val=93.10 Test=92.44 best=93.18@465 260621-13:35:36 (UTC+8)260621-13:35:37 (UTC+8)
21206_NoConditionalTopology Phase2 epoch=400/1706 Val=92.77 Test=92.29 best=92.90@385 260621-13:35:30 (UTC+8)260621-13:35:31 (UTC+8)
21106_NoConditionalTopology Phase2 epoch=300/1706 Val=91.88 Test=91.30 best=91.88@280 260621-13:35:24 (UTC+8)260621-13:35:25 (UTC+8)
21006_NoConditionalTopology Phase2 epoch=200/1706 Val=90.82 Test=90.37 best=90.82@200 260621-13:35:18 (UTC+8)260621-13:35:19 (UTC+8)
20906_NoConditionalTopology Phase2 epoch=100/1706 Val=89.40 Test=89.12 best=89.40@100 260621-13:35:10 (UTC+8)260621-13:35:12 (UTC+8)
20806_NoConditionalTopology Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-13:35:04 (UTC+8)260621-13:35:05 (UTC+8)
20706_NoConditionalTopology Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-13:35:02 (UTC+8)260621-13:35:04 (UTC+8)
20606_NoConditionalTopology Phase1 完成:best=93.94@686 targets=19717 260621-13:34:48 (UTC+8)260621-13:34:49 (UTC+8)
20506_NoConditionalTopology Phase1 epoch=2200/2256 best=93.94@686 260621-13:34:29 (UTC+8)260621-13:34:31 (UTC+8)
20406_NoConditionalTopology Phase1 epoch=2100/2256 best=93.94@686 260621-13:33:59 (UTC+8)260621-13:34:00 (UTC+8)
20306_NoConditionalTopology Phase1 epoch=2000/2256 best=93.94@686 260621-13:33:31 (UTC+8)260621-13:33:32 (UTC+8)
20206_NoConditionalTopology Phase1 epoch=1900/2256 best=93.94@686 260621-13:33:01 (UTC+8)260621-13:33:02 (UTC+8)
20106_NoConditionalTopology Phase1 epoch=1800/2256 best=93.94@686 260621-13:32:30 (UTC+8)260621-13:32:31 (UTC+8)
20006_NoConditionalTopology Phase1 epoch=1700/2256 best=93.94@686 260621-13:31:59 (UTC+8)260621-13:32:00 (UTC+8)
19906_NoConditionalTopology Phase1 epoch=1600/2256 best=93.94@686 260621-13:31:29 (UTC+8)260621-13:31:30 (UTC+8)
19806_NoConditionalTopology Phase1 epoch=1500/2256 best=93.94@686 260621-13:30:57 (UTC+8)260621-13:30:59 (UTC+8)
19706_NoConditionalTopology Phase1 epoch=1400/2256 best=93.94@686 260621-13:30:16 (UTC+8)260621-13:30:21 (UTC+8)
19606_NoConditionalTopology Phase1 epoch=1300/2256 best=93.94@686 260621-13:29:38 (UTC+8)260621-13:29:42 (UTC+8)
19506_NoConditionalTopology Phase1 epoch=1200/2256 best=93.94@686 260621-13:28:59 (UTC+8)260621-13:29:01 (UTC+8)
19406_NoConditionalTopology Phase1 epoch=1100/2256 best=93.94@686 260621-13:28:20 (UTC+8)260621-13:28:22 (UTC+8)
19306_NoConditionalTopology Phase1 epoch=1000/2256 best=93.94@686 260621-13:27:40 (UTC+8)260621-13:27:41 (UTC+8)
19206_NoConditionalTopology Phase1 epoch=900/2256 best=93.94@686 260621-13:27:01 (UTC+8)260621-13:27:02 (UTC+8)
19106_NoConditionalTopology Phase1 epoch=800/2256 best=93.94@686 260621-13:26:19 (UTC+8)260621-13:26:21 (UTC+8)
19006_NoConditionalTopology Phase1 epoch=700/2256 best=93.94@686 260621-13:25:41 (UTC+8)260621-13:25:42 (UTC+8)
18906_NoConditionalTopology Phase1 epoch=600/2256 best=93.91@171 260621-13:24:59 (UTC+8)260621-13:25:01 (UTC+8)
18806_NoConditionalTopology Phase1 epoch=500/2256 best=93.91@171 260621-13:24:21 (UTC+8)260621-13:24:22 (UTC+8)
18706_NoConditionalTopology Phase1 epoch=400/2256 best=93.91@171 260621-13:23:40 (UTC+8)260621-13:23:41 (UTC+8)
18606_NoConditionalTopology Phase1 epoch=300/2256 best=93.91@171 260621-13:22:59 (UTC+8)260621-13:23:00 (UTC+8)
18506_NoConditionalTopology Phase1 epoch=200/2256 best=93.91@171 260621-13:22:18 (UTC+8)260621-13:22:19 (UTC+8)
18406_NoConditionalTopology Phase1 epoch=100/2256 best=93.74@95 260621-13:21:37 (UTC+8)260621-13:21:39 (UTC+8)
18306_NoConditionalTopology Phase1 epoch=1/2256 best=70.02@1 260621-13:20:58 (UTC+8)260621-13:21:00 (UTC+8)
18206_NoConditionalTopology Phase1 启动:No conditional topology 260621-13:20:57 (UTC+8)260621-13:20:58 (UTC+8)
18106_NoConditionalTopology 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-13:20:52 (UTC+8)260621-13:20:53 (UTC+8)
18005_NoVIB 完成:Val=94.27 Test=93.15 MLP=92.62 GNN=91.53 260621-13:20:47 (UTC+8)260621-13:20:48 (UTC+8)
17905_NoVIB Phase2 完成:Val=94.27 Test=93.15 best_epoch=1410 260621-13:20:47 (UTC+8)260621-13:20:47 (UTC+8)
17805_NoVIB Phase2 epoch=1700/1706 Val=93.84 Test=92.67 best=94.27@1410 260621-13:20:46 (UTC+8)260621-13:20:46 (UTC+8)
17705_NoVIB Phase2 epoch=1600/1706 Val=94.01 Test=92.70 best=94.27@1410 260621-13:20:40 (UTC+8)260621-13:20:40 (UTC+8)
17605_NoVIB Phase2 epoch=1500/1706 Val=93.86 Test=92.70 best=94.27@1410 260621-13:20:32 (UTC+8)260621-13:20:34 (UTC+8)
17505_NoVIB Phase2 epoch=1400/1706 Val=93.91 Test=92.72 best=94.19@1185 260621-13:20:26 (UTC+8)260621-13:20:27 (UTC+8)
17405_NoVIB Phase2 epoch=1300/1706 Val=93.81 Test=92.65 best=94.19@1185 260621-13:20:20 (UTC+8)260621-13:20:21 (UTC+8)
17305_NoVIB Phase2 epoch=1200/1706 Val=93.81 Test=92.88 best=94.19@1185 260621-13:20:14 (UTC+8)260621-13:20:15 (UTC+8)
17205_NoVIB Phase2 epoch=1100/1706 Val=93.76 Test=92.80 best=94.14@905 260621-13:20:07 (UTC+8)260621-13:20:08 (UTC+8)
17105_NoVIB Phase2 epoch=1000/1706 Val=93.94 Test=93.05 best=94.14@905 260621-13:20:00 (UTC+8)260621-13:20:02 (UTC+8)
17005_NoVIB Phase2 epoch=900/1706 Val=93.89 Test=92.75 best=94.09@785 260621-13:19:54 (UTC+8)260621-13:19:55 (UTC+8)
16905_NoVIB Phase2 epoch=800/1706 Val=93.86 Test=92.82 best=94.09@785 260621-13:19:47 (UTC+8)260621-13:19:49 (UTC+8)
16805_NoVIB Phase2 epoch=700/1706 Val=93.51 Test=92.88 best=93.86@535 260621-13:19:41 (UTC+8)260621-13:19:42 (UTC+8)
16705_NoVIB Phase2 epoch=600/1706 Val=93.20 Test=92.29 best=93.86@535 260621-13:19:35 (UTC+8)260621-13:19:36 (UTC+8)
16605_NoVIB Phase2 epoch=500/1706 Val=93.23 Test=92.90 best=93.46@485 260621-13:19:27 (UTC+8)260621-13:19:29 (UTC+8)
16505_NoVIB Phase2 epoch=400/1706 Val=88.79 Test=88.39 best=92.92@375 260621-13:19:21 (UTC+8)260621-13:19:23 (UTC+8)
16405_NoVIB Phase2 epoch=300/1706 Val=92.24 Test=92.37 best=92.26@285 260621-13:19:15 (UTC+8)260621-13:19:17 (UTC+8)
16305_NoVIB Phase2 epoch=200/1706 Val=90.84 Test=90.64 best=91.15@190 260621-13:19:09 (UTC+8)260621-13:19:10 (UTC+8)
16205_NoVIB Phase2 epoch=100/1706 Val=89.83 Test=89.68 best=89.83@100 260621-13:19:03 (UTC+8)260621-13:19:03 (UTC+8)
16105_NoVIB Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-13:18:57 (UTC+8)260621-13:18:57 (UTC+8)
16005_NoVIB Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-13:18:54 (UTC+8)260621-13:18:56 (UTC+8)
15905_NoVIB Phase1 epoch=2200/2256 best=94.14@188 260621-13:18:13 (UTC+8)260621-13:18:15 (UTC+8)
15805_NoVIB Phase1 epoch=2100/2256 best=94.14@188 260621-13:17:38 (UTC+8)260621-13:17:40 (UTC+8)
15705_NoVIB Phase1 epoch=2000/2256 best=94.14@188 260621-13:17:02 (UTC+8)260621-13:17:03 (UTC+8)
15605_NoVIB Phase1 epoch=1900/2256 best=94.14@188 260621-13:16:26 (UTC+8)260621-13:16:28 (UTC+8)
15505_NoVIB Phase1 epoch=1700/2256 best=94.14@188 260621-13:15:11 (UTC+8)260621-13:15:12 (UTC+8)
15405_NoVIB Phase1 epoch=1600/2256 best=94.14@188 260621-13:14:34 (UTC+8)260621-13:14:35 (UTC+8)
15305_NoVIB Phase1 epoch=1400/2256 best=94.14@188 260621-13:13:07 (UTC+8)260621-13:13:09 (UTC+8)
15205_NoVIB Phase1 epoch=1300/2256 best=94.14@188 260621-13:12:19 (UTC+8)260621-13:12:20 (UTC+8)
15105_NoVIB Phase1 epoch=1200/2256 best=94.14@188 260621-13:11:31 (UTC+8)260621-13:11:32 (UTC+8)
15005_NoVIB Phase1 epoch=1000/2256 best=94.14@188 260621-13:09:54 (UTC+8)260621-13:09:56 (UTC+8)
14905_NoVIB Phase1 epoch=900/2256 best=94.14@188 260621-13:09:08 (UTC+8)260621-13:09:09 (UTC+8)
14805_NoVIB Phase1 epoch=800/2256 best=94.14@188 260621-13:08:21 (UTC+8)260621-13:08:22 (UTC+8)
14705_NoVIB Phase1 epoch=700/2256 best=94.14@188 260621-13:07:35 (UTC+8)260621-13:07:37 (UTC+8)
14605_NoVIB Phase1 epoch=600/2256 best=94.14@188 260621-13:06:48 (UTC+8)260621-13:06:52 (UTC+8)
14505_NoVIB Phase1 epoch=500/2256 best=94.14@188 260621-13:06:03 (UTC+8)260621-13:06:04 (UTC+8)
14405_NoVIB Phase1 epoch=400/2256 best=94.14@188 260621-13:05:16 (UTC+8)260621-13:05:18 (UTC+8)
14305_NoVIB Phase1 epoch=300/2256 best=94.14@188 260621-13:04:30 (UTC+8)260621-13:04:32 (UTC+8)
14205_NoVIB Phase1 epoch=200/2256 best=94.14@188 260621-13:03:44 (UTC+8)260621-13:03:45 (UTC+8)
14105_NoVIB Phase1 epoch=100/2256 best=93.99@85 260621-13:02:56 (UTC+8)260621-13:02:58 (UTC+8)
14005_NoVIB Phase1 epoch=1/2256 best=39.67@1 260621-13:02:04 (UTC+8)260621-13:02:05 (UTC+8)
13905_NoVIB Phase1 启动:No VIB bottleneck 260621-13:02:02 (UTC+8)260621-13:02:03 (UTC+8)
13805_NoVIB 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-13:01:58 (UTC+8)260621-13:01:58 (UTC+8)
13704_NoSemanticGlobalInvariance 完成:Val=94.22 Test=92.67 MLP=91.91 GNN=91.63 260621-13:01:53 (UTC+8)260621-13:01:54 (UTC+8)
13604_NoSemanticGlobalInvariance Phase2 完成:Val=94.22 Test=92.67 best_epoch=1085 260621-13:01:51 (UTC+8)260621-13:01:53 (UTC+8)
13504_NoSemanticGlobalInvariance Phase2 epoch=1700/1706 Val=93.94 Test=92.70 best=94.22@1085 260621-13:01:49 (UTC+8)260621-13:01:51 (UTC+8)
13404_NoSemanticGlobalInvariance Phase2 epoch=1600/1706 Val=93.79 Test=92.55 best=94.22@1085 260621-13:01:36 (UTC+8)260621-13:01:37 (UTC+8)
13304_NoSemanticGlobalInvariance Phase2 epoch=1500/1706 Val=93.38 Test=91.81 best=94.22@1085 260621-13:01:23 (UTC+8)260621-13:01:23 (UTC+8)
13204_NoSemanticGlobalInvariance Phase2 epoch=1400/1706 Val=93.63 Test=92.67 best=94.22@1085 260621-13:01:08 (UTC+8)260621-13:01:10 (UTC+8)
13104_NoSemanticGlobalInvariance Phase2 epoch=1300/1706 Val=93.53 Test=92.65 best=94.22@1085 260621-13:00:55 (UTC+8)260621-13:00:56 (UTC+8)
13004_NoSemanticGlobalInvariance Phase2 epoch=1200/1706 Val=93.71 Test=92.70 best=94.22@1085 260621-13:00:40 (UTC+8)260621-13:00:41 (UTC+8)
12904_NoSemanticGlobalInvariance Phase2 epoch=1100/1706 Val=94.17 Test=92.72 best=94.22@1085 260621-13:00:26 (UTC+8)260621-13:00:28 (UTC+8)
12804_NoSemanticGlobalInvariance Phase2 epoch=1000/1706 Val=93.74 Test=93.03 best=94.07@910 260621-13:00:13 (UTC+8)260621-13:00:14 (UTC+8)
12704_NoSemanticGlobalInvariance Phase2 epoch=900/1706 Val=93.08 Test=92.57 best=93.91@870 260621-12:59:58 (UTC+8)260621-12:59:59 (UTC+8)
12604_NoSemanticGlobalInvariance Phase2 epoch=800/1706 Val=93.76 Test=92.37 best=93.76@800 260621-12:59:44 (UTC+8)260621-12:59:45 (UTC+8)
12504_NoSemanticGlobalInvariance Phase2 epoch=700/1706 Val=93.56 Test=92.22 best=93.56@700 260621-12:59:30 (UTC+8)260621-12:59:32 (UTC+8)
12404_NoSemanticGlobalInvariance Phase2 epoch=600/1706 Val=92.34 Test=91.81 best=93.38@555 260621-12:59:17 (UTC+8)260621-12:59:18 (UTC+8)
12304_NoSemanticGlobalInvariance Phase2 epoch=500/1706 Val=92.80 Test=91.81 best=92.92@425 260621-12:59:03 (UTC+8)260621-12:59:04 (UTC+8)
12204_NoSemanticGlobalInvariance Phase2 epoch=400/1706 Val=92.06 Test=91.18 best=92.65@385 260621-12:58:50 (UTC+8)260621-12:58:51 (UTC+8)
12104_NoSemanticGlobalInvariance Phase2 epoch=300/1706 Val=91.58 Test=91.35 best=91.66@295 260621-12:58:36 (UTC+8)260621-12:58:37 (UTC+8)
12004_NoSemanticGlobalInvariance Phase2 epoch=200/1706 Val=90.57 Test=90.59 best=90.62@195 260621-12:58:19 (UTC+8)260621-12:58:23 (UTC+8)
11904_NoSemanticGlobalInvariance Phase2 epoch=100/1706 Val=89.78 Test=89.55 best=89.78@100 260621-12:58:06 (UTC+8)260621-12:58:08 (UTC+8)
11804_NoSemanticGlobalInvariance Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-12:57:52 (UTC+8)260621-12:57:54 (UTC+8)
11704_NoSemanticGlobalInvariance Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-12:57:51 (UTC+8)260621-12:57:53 (UTC+8)
11604_NoSemanticGlobalInvariance Phase1 完成:best=93.86@248 targets=19717 260621-12:56:39 (UTC+8)260621-12:56:40 (UTC+8)
11504_NoSemanticGlobalInvariance Phase1 epoch=2200/2256 best=93.86@248 260621-12:56:10 (UTC+8)260621-12:56:11 (UTC+8)
11404_NoSemanticGlobalInvariance Phase1 epoch=2100/2256 best=93.86@248 260621-12:55:19 (UTC+8)260621-12:55:20 (UTC+8)
11304_NoSemanticGlobalInvariance Phase1 epoch=2000/2256 best=93.86@248 260621-12:54:26 (UTC+8)260621-12:54:27 (UTC+8)
11204_NoSemanticGlobalInvariance Phase1 epoch=1900/2256 best=93.86@248 260621-12:53:33 (UTC+8)260621-12:53:35 (UTC+8)
11104_NoSemanticGlobalInvariance Phase1 epoch=1800/2256 best=93.86@248 260621-12:52:42 (UTC+8)260621-12:52:44 (UTC+8)
11004_NoSemanticGlobalInvariance Phase1 epoch=1700/2256 best=93.86@248 260621-12:51:49 (UTC+8)260621-12:51:51 (UTC+8)
10904_NoSemanticGlobalInvariance Phase1 epoch=1600/2256 best=93.86@248 260621-12:50:57 (UTC+8)260621-12:50:58 (UTC+8)
10804_NoSemanticGlobalInvariance Phase1 epoch=1500/2256 best=93.86@248 260621-12:50:04 (UTC+8)260621-12:50:06 (UTC+8)
10704_NoSemanticGlobalInvariance Phase1 epoch=1400/2256 best=93.86@248 260621-12:48:58 (UTC+8)260621-12:49:00 (UTC+8)
10604_NoSemanticGlobalInvariance Phase1 epoch=1200/2256 best=93.86@248 260621-12:46:39 (UTC+8)260621-12:46:41 (UTC+8)
10504_NoSemanticGlobalInvariance Phase1 epoch=1100/2256 best=93.86@248 260621-12:45:30 (UTC+8)260621-12:45:33 (UTC+8)
10404_NoSemanticGlobalInvariance Phase1 epoch=1000/2256 best=93.86@248 260621-12:44:24 (UTC+8)260621-12:44:26 (UTC+8)
10304_NoSemanticGlobalInvariance Phase1 epoch=900/2256 best=93.86@248 260621-12:43:19 (UTC+8)260621-12:43:20 (UTC+8)
10204_NoSemanticGlobalInvariance Phase1 epoch=800/2256 best=93.86@248 260621-12:42:13 (UTC+8)260621-12:42:14 (UTC+8)
10104_NoSemanticGlobalInvariance Phase1 epoch=700/2256 best=93.86@248 260621-12:41:06 (UTC+8)260621-12:41:07 (UTC+8)
10004_NoSemanticGlobalInvariance Phase1 epoch=600/2256 best=93.86@248 260621-12:39:59 (UTC+8)260621-12:40:01 (UTC+8)
9904_NoSemanticGlobalInvariance Phase1 epoch=400/2256 best=93.86@248 260621-12:37:41 (UTC+8)260621-12:37:43 (UTC+8)
9804_NoSemanticGlobalInvariance Phase1 epoch=300/2256 best=93.86@248 260621-12:36:34 (UTC+8)260621-12:36:35 (UTC+8)
9704_NoSemanticGlobalInvariance Phase1 epoch=200/2256 best=93.74@187 260621-12:35:25 (UTC+8)260621-12:35:27 (UTC+8)
9604_NoSemanticGlobalInvariance Phase1 epoch=100/2256 best=93.66@16 260621-12:34:19 (UTC+8)260621-12:34:21 (UTC+8)
9504_NoSemanticGlobalInvariance Phase1 epoch=1/2256 best=39.67@1 260621-12:33:14 (UTC+8)260621-12:33:16 (UTC+8)
9404_NoSemanticGlobalInvariance Phase1 启动:No semantic global invariance 260621-12:33:12 (UTC+8)260621-12:33:14 (UTC+8)
9304_NoSemanticGlobalInvariance 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-12:33:07 (UTC+8)260621-12:33:09 (UTC+8)
9203_NoOrderInvariance Phase2 完成:Val=94.65 Test=93.31 best_epoch=1570 260621-12:32:57 (UTC+8)260621-12:32:58 (UTC+8)
9103_NoOrderInvariance Phase2 epoch=1700/1706 Val=94.27 Test=92.93 best=94.65@1570 260621-12:32:55 (UTC+8)260621-12:32:56 (UTC+8)
9003_NoOrderInvariance Phase2 epoch=1600/1706 Val=94.37 Test=93.26 best=94.65@1570 260621-12:32:40 (UTC+8)260621-12:32:43 (UTC+8)
8903_NoOrderInvariance Phase2 epoch=1500/1706 Val=93.89 Test=92.80 best=94.62@1290 260621-12:32:28 (UTC+8)260621-12:32:30 (UTC+8)
8803_NoOrderInvariance Phase2 epoch=1400/1706 Val=94.37 Test=93.36 best=94.62@1290 260621-12:32:15 (UTC+8)260621-12:32:16 (UTC+8)
8703_NoOrderInvariance Phase2 epoch=1300/1706 Val=94.52 Test=93.28 best=94.62@1290 260621-12:32:00 (UTC+8)260621-12:32:02 (UTC+8)
8603_NoOrderInvariance Phase2 epoch=1200/1706 Val=94.37 Test=93.48 best=94.50@1175 260621-12:31:47 (UTC+8)260621-12:31:48 (UTC+8)
8503_NoOrderInvariance Phase2 epoch=1100/1706 Val=93.79 Test=93.20 best=94.40@950 260621-12:31:32 (UTC+8)260621-12:31:34 (UTC+8)
8403_NoOrderInvariance Phase2 epoch=1000/1706 Val=93.43 Test=92.90 best=94.40@950 260621-12:31:19 (UTC+8)260621-12:31:20 (UTC+8)
8303_NoOrderInvariance Phase2 epoch=900/1706 Val=94.12 Test=93.53 best=94.32@855 260621-12:31:06 (UTC+8)260621-12:31:07 (UTC+8)
8203_NoOrderInvariance Phase2 epoch=800/1706 Val=93.46 Test=92.67 best=94.12@705 260621-12:30:51 (UTC+8)260621-12:30:53 (UTC+8)
8103_NoOrderInvariance Phase2 epoch=700/1706 Val=93.91 Test=93.31 best=94.04@575 260621-12:30:43 (UTC+8)260621-12:30:44 (UTC+8)
8003_NoOrderInvariance Phase2 epoch=600/1706 Val=93.61 Test=93.56 best=94.04@575 260621-12:30:35 (UTC+8)260621-12:30:36 (UTC+8)
7903_NoOrderInvariance Phase2 epoch=500/1706 Val=93.81 Test=93.33 best=93.84@490 260621-12:30:29 (UTC+8)260621-12:30:30 (UTC+8)
7803_NoOrderInvariance Phase2 epoch=400/1706 Val=93.30 Test=92.60 best=93.30@400 260621-12:30:21 (UTC+8)260621-12:30:23 (UTC+8)
7703_NoOrderInvariance Phase2 epoch=300/1706 Val=92.62 Test=92.09 best=92.82@285 260621-12:30:15 (UTC+8)260621-12:30:17 (UTC+8)
7603_NoOrderInvariance Phase2 epoch=200/1706 Val=91.86 Test=91.25 best=91.86@195 260621-12:30:09 (UTC+8)260621-12:30:11 (UTC+8)
7503_NoOrderInvariance Phase2 epoch=100/1706 Val=89.98 Test=89.86 best=89.98@100 260621-12:30:03 (UTC+8)260621-12:30:04 (UTC+8)
7403_NoOrderInvariance Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-12:29:57 (UTC+8)260621-12:29:58 (UTC+8)
7303_NoOrderInvariance Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-12:29:56 (UTC+8)260621-12:29:57 (UTC+8)
7203_NoOrderInvariance Phase1 完成:best=94.12@222 targets=19717 260621-12:29:40 (UTC+8)260621-12:29:41 (UTC+8)
7103_NoOrderInvariance Phase1 epoch=2200/2256 best=94.12@222 260621-12:29:22 (UTC+8)260621-12:29:23 (UTC+8)
7003_NoOrderInvariance Phase1 epoch=2100/2256 best=94.12@222 260621-12:28:47 (UTC+8)260621-12:28:48 (UTC+8)
6903_NoOrderInvariance Phase1 epoch=2000/2256 best=94.12@222 260621-12:28:14 (UTC+8)260621-12:28:15 (UTC+8)
6803_NoOrderInvariance Phase1 epoch=1900/2256 best=94.12@222 260621-12:27:38 (UTC+8)260621-12:27:39 (UTC+8)
6703_NoOrderInvariance Phase1 epoch=1800/2256 best=94.12@222 260621-12:27:02 (UTC+8)260621-12:27:02 (UTC+8)
6603_NoOrderInvariance Phase1 epoch=1700/2256 best=94.12@222 260621-12:26:26 (UTC+8)260621-12:26:27 (UTC+8)
6503_NoOrderInvariance Phase1 epoch=1600/2256 best=94.12@222 260621-12:25:44 (UTC+8)260621-12:25:46 (UTC+8)
6403_NoOrderInvariance Phase1 epoch=1500/2256 best=94.12@222 260621-12:24:55 (UTC+8)260621-12:24:56 (UTC+8)
6303_NoOrderInvariance Phase1 epoch=1400/2256 best=94.12@222 260621-12:23:49 (UTC+8)260621-12:23:51 (UTC+8)
6203_NoOrderInvariance Phase1 epoch=1300/2256 best=94.12@222 260621-12:22:45 (UTC+8)260621-12:22:47 (UTC+8)
6103_NoOrderInvariance Phase1 epoch=1200/2256 best=94.12@222 260621-12:21:41 (UTC+8)260621-12:21:42 (UTC+8)
6003_NoOrderInvariance Phase1 epoch=1100/2256 best=94.12@222 260621-12:20:36 (UTC+8)260621-12:20:38 (UTC+8)
5903_NoOrderInvariance Phase1 epoch=1000/2256 best=94.12@222 260621-12:19:30 (UTC+8)260621-12:19:32 (UTC+8)
5803_NoOrderInvariance Phase1 epoch=900/2256 best=94.12@222 260621-12:18:27 (UTC+8)260621-12:18:28 (UTC+8)
5703_NoOrderInvariance Phase1 epoch=800/2256 best=94.12@222 260621-12:17:22 (UTC+8)260621-12:17:23 (UTC+8)
5603_NoOrderInvariance Phase1 epoch=700/2256 best=94.12@222 260621-12:16:29 (UTC+8)260621-12:16:30 (UTC+8)
5503_NoOrderInvariance Phase1 epoch=600/2256 best=94.12@222 260621-12:15:42 (UTC+8)260621-12:15:43 (UTC+8)
5403_NoOrderInvariance Phase1 epoch=500/2256 best=94.12@222 260621-12:14:55 (UTC+8)260621-12:14:57 (UTC+8)
5303_NoOrderInvariance Phase1 epoch=400/2256 best=94.12@222 260621-12:13:55 (UTC+8)260621-12:13:56 (UTC+8)
5203_NoOrderInvariance Phase1 epoch=300/2256 best=94.12@222 260621-12:12:52 (UTC+8)260621-12:12:53 (UTC+8)
5103_NoOrderInvariance Phase1 epoch=200/2256 best=94.09@133 260621-12:11:47 (UTC+8)260621-12:11:48 (UTC+8)
5003_NoOrderInvariance Phase1 epoch=100/2256 best=94.01@100 260621-12:10:42 (UTC+8)260621-12:10:44 (UTC+8)
4903_NoOrderInvariance Phase1 epoch=1/2256 best=39.67@1 260621-12:08:40 (UTC+8)260621-12:09:39 (UTC+8)
4803_NoOrderInvariance Phase1 启动:No topology order invariance 260621-12:08:38 (UTC+8)260621-12:09:37 (UTC+8)
4703_NoOrderInvariance 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-12:08:33 (UTC+8)260621-12:09:31 (UTC+8)
4602_RawHiddenDistill 完成:Val=90.31 Test=89.86 MLP=87.96 GNN=88.95 260621-12:08:28 (UTC+8)260621-12:09:27 (UTC+8)
4502_RawHiddenDistill Phase2 完成:Val=90.31 Test=89.86 best_epoch=1365 260621-12:08:27 (UTC+8)260621-12:09:26 (UTC+8)
4402_RawHiddenDistill Phase2 epoch=1700/1706 Val=89.70 Test=89.68 best=90.31@1365 260621-12:08:25 (UTC+8)260621-12:09:24 (UTC+8)
4302_RawHiddenDistill Phase2 epoch=1600/1706 Val=84.45 Test=84.66 best=90.31@1365 260621-12:08:13 (UTC+8)260621-12:09:11 (UTC+8)
4202_RawHiddenDistill Phase2 epoch=1500/1706 Val=89.83 Test=89.43 best=90.31@1365 260621-12:08:00 (UTC+8)260621-12:08:57 (UTC+8)
4102_RawHiddenDistill Phase2 epoch=1400/1706 Val=90.06 Test=89.71 best=90.31@1365 260621-12:07:47 (UTC+8)260621-12:08:44 (UTC+8)
4002_RawHiddenDistill Phase2 epoch=1300/1706 Val=72.96 Test=74.14 best=90.13@1155 260621-12:07:35 (UTC+8)260621-12:08:31 (UTC+8)
3902_RawHiddenDistill Phase2 epoch=1200/1706 Val=89.50 Test=89.02 best=90.13@1155 260621-12:07:22 (UTC+8)260621-12:08:18 (UTC+8)
3802_RawHiddenDistill Phase2 epoch=1100/1706 Val=88.82 Test=88.51 best=89.98@950 260621-12:07:09 (UTC+8)260621-12:08:05 (UTC+8)
3702_RawHiddenDistill Phase2 epoch=1000/1706 Val=89.40 Test=89.20 best=89.98@950 260621-12:06:57 (UTC+8)260621-12:07:51 (UTC+8)
3602_RawHiddenDistill Phase2 epoch=900/1706 Val=87.52 Test=87.45 best=89.91@525 260621-12:06:43 (UTC+8)260621-12:07:37 (UTC+8)
3502_RawHiddenDistill Phase2 epoch=800/1706 Val=89.42 Test=89.78 best=89.91@525 260621-12:06:30 (UTC+8)260621-12:07:24 (UTC+8)
3402_RawHiddenDistill Phase2 epoch=700/1706 Val=89.27 Test=89.63 best=89.91@525 260621-12:06:17 (UTC+8)260621-12:07:10 (UTC+8)
3302_RawHiddenDistill Phase2 epoch=600/1706 Val=87.60 Test=87.80 best=89.91@525 260621-12:06:04 (UTC+8)260621-12:06:57 (UTC+8)
3202_RawHiddenDistill Phase2 epoch=500/1706 Val=89.55 Test=89.71 best=89.78@340 260621-12:05:52 (UTC+8)260621-12:06:45 (UTC+8)
3102_RawHiddenDistill Phase2 epoch=400/1706 Val=89.53 Test=89.55 best=89.78@340 260621-12:05:44 (UTC+8)260621-12:06:36 (UTC+8)
3002_RawHiddenDistill Phase2 epoch=300/1706 Val=88.82 Test=88.62 best=89.53@210 260621-12:05:37 (UTC+8)260621-12:06:29 (UTC+8)
2902_RawHiddenDistill Phase2 epoch=200/1706 Val=88.13 Test=88.08 best=89.45@175 260621-12:05:23 (UTC+8)260621-12:06:14 (UTC+8)
2802_RawHiddenDistill Phase2 epoch=100/1706 Val=88.76 Test=88.64 best=88.76@100 260621-12:05:10 (UTC+8)260621-12:06:00 (UTC+8)
2702_RawHiddenDistill Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-12:04:56 (UTC+8)260621-12:05:46 (UTC+8)
2602_RawHiddenDistill Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-12:04:55 (UTC+8)260621-12:05:45 (UTC+8)
2502_RawHiddenDistill 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-12:03:49 (UTC+8)260621-12:04:36 (UTC+8)
2401_TaskOnly 完成:Val=90.03 Test=89.07 MLP=87.58 GNN=87.37 260621-12:03:44 (UTC+8)260621-12:04:31 (UTC+8)
2301_TaskOnly Phase2 完成:Val=90.03 Test=89.07 best_epoch=505 260621-12:03:43 (UTC+8)260621-12:04:30 (UTC+8)
2201_TaskOnly Phase2 epoch=1700/1706 Val=86.86 Test=87.12 best=90.03@505 260621-12:03:41 (UTC+8)260621-12:04:28 (UTC+8)
2101_TaskOnly Phase2 epoch=1600/1706 Val=87.24 Test=87.70 best=90.03@505 260621-12:03:32 (UTC+8)260621-12:04:18 (UTC+8)
2001_TaskOnly Phase2 epoch=1500/1706 Val=87.55 Test=87.50 best=90.03@505 260621-12:03:22 (UTC+8)260621-12:04:08 (UTC+8)
1901_TaskOnly Phase2 epoch=1400/1706 Val=87.95 Test=87.96 best=90.03@505 260621-12:03:13 (UTC+8)260621-12:03:58 (UTC+8)
1801_TaskOnly Phase2 epoch=1300/1706 Val=88.23 Test=87.75 best=90.03@505 260621-12:03:04 (UTC+8)260621-12:03:49 (UTC+8)
1701_TaskOnly Phase2 epoch=1200/1706 Val=70.58 Test=71.02 best=90.03@505 260621-12:02:55 (UTC+8)260621-12:03:39 (UTC+8)
1601_TaskOnly Phase2 epoch=1100/1706 Val=88.38 Test=88.01 best=90.03@505 260621-12:02:45 (UTC+8)260621-12:03:29 (UTC+8)
1501_TaskOnly Phase2 epoch=1000/1706 Val=88.41 Test=87.55 best=90.03@505 260621-12:02:36 (UTC+8)260621-12:03:20 (UTC+8)
1401_TaskOnly Phase2 epoch=900/1706 Val=89.02 Test=88.72 best=90.03@505 260621-12:02:27 (UTC+8)260621-12:03:10 (UTC+8)
1301_TaskOnly Phase2 epoch=800/1706 Val=89.65 Test=88.84 best=90.03@505 260621-12:02:18 (UTC+8)260621-12:03:01 (UTC+8)
1201_TaskOnly Phase2 epoch=700/1706 Val=88.64 Test=87.15 best=90.03@505 260621-12:02:08 (UTC+8)260621-12:02:50 (UTC+8)
1101_TaskOnly Phase2 epoch=600/1706 Val=88.28 Test=87.85 best=90.03@505 260621-12:01:59 (UTC+8)260621-12:02:41 (UTC+8)
1001_TaskOnly Phase2 epoch=500/1706 Val=85.42 Test=84.36 best=89.93@390 260621-12:01:50 (UTC+8)260621-12:02:32 (UTC+8)
901_TaskOnly Phase2 epoch=400/1706 Val=89.88 Test=89.63 best=89.93@390 260621-12:01:40 (UTC+8)260621-12:02:22 (UTC+8)
801_TaskOnly Phase2 epoch=300/1706 Val=89.42 Test=89.05 best=89.83@235 260621-12:01:32 (UTC+8)260621-12:02:13 (UTC+8)
701_TaskOnly Phase2 epoch=200/1706 Val=89.48 Test=89.22 best=89.78@165 260621-12:01:22 (UTC+8)260621-12:02:03 (UTC+8)
601_TaskOnly Phase2 epoch=100/1706 Val=89.25 Test=89.25 best=89.32@95 260621-12:01:12 (UTC+8)260621-12:01:52 (UTC+8)
501_TaskOnly Phase2 epoch=1/1706 Val=55.85 Test=56.59 best=55.85@1 260621-12:01:02 (UTC+8)260621-12:01:42 (UTC+8)
401_TaskOnly Phase2 启动:distill_nodes=0 alpha_d=0.0 260621-12:01:01 (UTC+8)260621-12:01:41 (UTC+8)
301_TaskOnly 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-12:00:56 (UTC+8)260621-12:01:35 (UTC+8)
2主流程已结束,开始追加 01-13 标准矩阵消融 260621-12:00:52 (UTC+8)260621-12:01:32 (UTC+8)
1remaining matrix watcher 已启动:等待主流程 PID=2586031 260620-12:50:54 (UTC+8)260620-12:50:55 (UTC+8)
#04

PubMed9999Orthrusdelayed36h

▦ table
last update
260621-12:01:26
records
219
type
text
latest
18_VarianceAwareSemanticPooling 完成:Val=94.12 Test=92.88 MLP=91.84 GNN=92.32 260621-12:00:47 (UTC+8)
ID数值接收时间
21918_VarianceAwareSemanticPooling 完成:Val=94.12 Test=92.88 MLP=91.84 GNN=92.32 260621-12:00:47 (UTC+8)260621-12:01:26 (UTC+8)
21818_VarianceAwareSemanticPooling Phase2 完成:Val=94.12 Test=92.88 best_epoch=1205 260621-12:00:46 (UTC+8)260621-12:01:25 (UTC+8)
21718_VarianceAwareSemanticPooling Phase2 epoch=1700/1706 Val=93.91 Test=92.93 best=94.12@1205 260621-12:00:44 (UTC+8)260621-12:01:24 (UTC+8)
21618_VarianceAwareSemanticPooling Phase2 epoch=1600/1706 Val=94.09 Test=93.15 best=94.12@1205 260621-12:00:36 (UTC+8)260621-12:01:16 (UTC+8)
21518_VarianceAwareSemanticPooling Phase2 epoch=1500/1706 Val=93.41 Test=92.44 best=94.12@1205 260621-12:00:28 (UTC+8)260621-12:01:07 (UTC+8)
21418_VarianceAwareSemanticPooling Phase2 epoch=1400/1706 Val=93.58 Test=92.72 best=94.12@1205 260621-12:00:20 (UTC+8)260621-12:00:59 (UTC+8)
21318_VarianceAwareSemanticPooling Phase2 epoch=1300/1706 Val=93.84 Test=92.98 best=94.12@1205 260621-12:00:12 (UTC+8)260621-12:00:50 (UTC+8)
21218_VarianceAwareSemanticPooling Phase2 epoch=1200/1706 Val=94.04 Test=93.00 best=94.09@1155 260621-12:00:05 (UTC+8)260621-12:00:42 (UTC+8)
21118_VarianceAwareSemanticPooling Phase2 epoch=1100/1706 Val=93.53 Test=92.39 best=94.01@935 260621-11:59:57 (UTC+8)260621-12:00:34 (UTC+8)
21018_VarianceAwareSemanticPooling Phase2 epoch=1000/1706 Val=93.51 Test=92.77 best=94.01@935 260621-11:59:49 (UTC+8)260621-12:00:26 (UTC+8)
20918_VarianceAwareSemanticPooling Phase2 epoch=900/1706 Val=93.46 Test=92.88 best=93.58@810 260621-11:59:40 (UTC+8)260621-12:00:18 (UTC+8)
20818_VarianceAwareSemanticPooling Phase2 epoch=800/1706 Val=93.53 Test=92.80 best=93.53@800 260621-11:59:32 (UTC+8)260621-12:00:09 (UTC+8)
20718_VarianceAwareSemanticPooling Phase2 epoch=700/1706 Val=92.97 Test=92.60 best=93.18@690 260621-11:59:24 (UTC+8)260621-12:00:01 (UTC+8)
20618_VarianceAwareSemanticPooling Phase2 epoch=600/1706 Val=92.37 Test=91.91 best=92.97@570 260621-11:59:16 (UTC+8)260621-11:59:52 (UTC+8)
20518_VarianceAwareSemanticPooling Phase2 epoch=500/1706 Val=92.75 Test=92.39 best=92.80@445 260621-11:59:08 (UTC+8)260621-11:59:44 (UTC+8)
20418_VarianceAwareSemanticPooling Phase2 epoch=400/1706 Val=92.44 Test=92.06 best=92.44@400 260621-11:59:00 (UTC+8)260621-11:59:35 (UTC+8)
20318_VarianceAwareSemanticPooling Phase2 epoch=300/1706 Val=92.06 Test=91.78 best=92.06@300 260621-11:58:52 (UTC+8)260621-11:59:27 (UTC+8)
20218_VarianceAwareSemanticPooling Phase2 epoch=100/1706 Val=89.20 Test=90.19 best=89.25@95 260621-11:58:33 (UTC+8)260621-11:59:06 (UTC+8)
20118_VarianceAwareSemanticPooling Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-11:58:25 (UTC+8)260621-11:58:59 (UTC+8)
20018_VarianceAwareSemanticPooling Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-11:58:24 (UTC+8)260621-11:58:57 (UTC+8)
19918_VarianceAwareSemanticPooling Phase1 完成:best=94.17@218 targets=19717 260621-11:58:09 (UTC+8)260621-11:58:41 (UTC+8)
19818_VarianceAwareSemanticPooling Phase1 epoch=2200/2256 best=94.17@218 260621-11:57:48 (UTC+8)260621-11:58:19 (UTC+8)
19718_VarianceAwareSemanticPooling Phase1 epoch=2100/2256 best=94.17@218 260621-11:57:09 (UTC+8)260621-11:57:40 (UTC+8)
19618_VarianceAwareSemanticPooling Phase1 epoch=2000/2256 best=94.17@218 260621-11:56:31 (UTC+8)260621-11:57:00 (UTC+8)
19518_VarianceAwareSemanticPooling Phase1 epoch=1900/2256 best=94.17@218 260621-11:56:11 (UTC+8)260621-11:56:39 (UTC+8)
19418_VarianceAwareSemanticPooling Phase1 epoch=1800/2256 best=94.17@218 260621-11:55:51 (UTC+8)260621-11:56:18 (UTC+8)
19318_VarianceAwareSemanticPooling Phase1 epoch=1700/2256 best=94.17@218 260621-11:55:31 (UTC+8)260621-11:55:57 (UTC+8)
19218_VarianceAwareSemanticPooling Phase1 epoch=1600/2256 best=94.17@218 260621-11:55:10 (UTC+8)260621-11:55:35 (UTC+8)
19118_VarianceAwareSemanticPooling Phase1 epoch=1500/2256 best=94.17@218 260621-11:54:32 (UTC+8)260621-11:54:56 (UTC+8)
19018_VarianceAwareSemanticPooling Phase1 epoch=1400/2256 best=94.17@218 260621-11:53:44 (UTC+8)260621-11:54:06 (UTC+8)
18918_VarianceAwareSemanticPooling Phase1 epoch=1300/2256 best=94.17@218 260621-11:52:56 (UTC+8)260621-11:53:15 (UTC+8)
18818_VarianceAwareSemanticPooling Phase1 epoch=1200/2256 best=94.17@218 260621-11:52:07 (UTC+8)260621-11:52:25 (UTC+8)
18718_VarianceAwareSemanticPooling Phase1 epoch=1100/2256 best=94.17@218 260621-11:51:19 (UTC+8)260621-11:51:34 (UTC+8)
18618_VarianceAwareSemanticPooling Phase1 epoch=1000/2256 best=94.17@218 260621-11:50:29 (UTC+8)260621-11:50:43 (UTC+8)
18518_VarianceAwareSemanticPooling Phase1 epoch=900/2256 best=94.17@218 260621-11:49:40 (UTC+8)260621-11:49:52 (UTC+8)
18418_VarianceAwareSemanticPooling Phase1 epoch=800/2256 best=94.17@218 260621-11:48:53 (UTC+8)260621-11:49:03 (UTC+8)
18318_VarianceAwareSemanticPooling Phase1 epoch=700/2256 best=94.17@218 260621-11:48:04 (UTC+8)260621-11:48:12 (UTC+8)
18218_VarianceAwareSemanticPooling Phase1 epoch=600/2256 best=94.17@218 260621-11:47:16 (UTC+8)260621-11:47:21 (UTC+8)
18118_VarianceAwareSemanticPooling Phase1 epoch=500/2256 best=94.17@218 260621-11:46:27 (UTC+8)260621-11:46:31 (UTC+8)
18018_VarianceAwareSemanticPooling Phase1 epoch=400/2256 best=94.17@218 260621-11:45:38 (UTC+8)260621-11:45:40 (UTC+8)
17918_VarianceAwareSemanticPooling Phase1 epoch=300/2256 best=94.17@218 260621-11:44:48 (UTC+8)260621-11:44:49 (UTC+8)
17818_VarianceAwareSemanticPooling Phase1 epoch=200/2256 best=94.09@152 260621-11:43:56 (UTC+8)260621-11:43:57 (UTC+8)
17718_VarianceAwareSemanticPooling Phase1 epoch=100/2256 best=93.96@70 260621-11:43:05 (UTC+8)260621-11:43:06 (UTC+8)
17618_VarianceAwareSemanticPooling Phase1 epoch=1/2256 best=39.67@1 260621-11:42:15 (UTC+8)260621-11:42:16 (UTC+8)
17518_VarianceAwareSemanticPooling Phase1 启动:Variance-aware semantic pooling 260621-11:42:14 (UTC+8)260621-11:42:14 (UTC+8)
17418_VarianceAwareSemanticPooling 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=1 260621-11:42:08 (UTC+8)260621-11:42:10 (UTC+8)
17317_GeometricMedianTopology 完成:Val=94.67 Test=93.76 MLP=91.78 GNN=92.19 260621-11:42:03 (UTC+8)260621-11:42:05 (UTC+8)
17217_GeometricMedianTopology Phase2 完成:Val=94.67 Test=93.76 best_epoch=1550 260621-11:42:02 (UTC+8)260621-11:42:04 (UTC+8)
17117_GeometricMedianTopology Phase2 epoch=1700/1706 Val=94.60 Test=93.31 best=94.67@1550 260621-11:42:00 (UTC+8)260621-11:42:02 (UTC+8)
17017_GeometricMedianTopology Phase2 epoch=1600/1706 Val=94.52 Test=93.71 best=94.67@1550 260621-11:41:52 (UTC+8)260621-11:41:54 (UTC+8)
16917_GeometricMedianTopology Phase2 epoch=1500/1706 Val=94.52 Test=93.69 best=94.57@1475 260621-11:41:45 (UTC+8)260621-11:41:46 (UTC+8)
16817_GeometricMedianTopology Phase2 epoch=1400/1706 Val=94.47 Test=93.51 best=94.47@1300 260621-11:41:35 (UTC+8)260621-11:41:37 (UTC+8)
16717_GeometricMedianTopology Phase2 epoch=1300/1706 Val=94.47 Test=93.59 best=94.47@1300 260621-11:41:27 (UTC+8)260621-11:41:29 (UTC+8)
16617_GeometricMedianTopology Phase2 epoch=1200/1706 Val=94.24 Test=93.81 best=94.42@905 260621-11:41:19 (UTC+8)260621-11:41:21 (UTC+8)
16517_GeometricMedianTopology Phase2 epoch=1100/1706 Val=94.17 Test=93.74 best=94.42@905 260621-11:41:12 (UTC+8)260621-11:41:13 (UTC+8)
16417_GeometricMedianTopology Phase2 epoch=1000/1706 Val=94.01 Test=93.81 best=94.42@905 260621-11:41:04 (UTC+8)260621-11:41:05 (UTC+8)
16317_GeometricMedianTopology Phase2 epoch=900/1706 Val=93.81 Test=93.56 best=94.04@890 260621-11:40:55 (UTC+8)260621-11:40:57 (UTC+8)
16217_GeometricMedianTopology Phase2 epoch=800/1706 Val=92.90 Test=92.75 best=93.91@705 260621-11:40:47 (UTC+8)260621-11:40:49 (UTC+8)
16117_GeometricMedianTopology Phase2 epoch=600/1706 Val=93.36 Test=93.05 best=93.81@560 260621-11:40:29 (UTC+8)260621-11:40:30 (UTC+8)
16017_GeometricMedianTopology Phase2 epoch=500/1706 Val=93.28 Test=92.77 best=93.66@485 260621-11:40:25 (UTC+8)260621-11:40:27 (UTC+8)
15917_GeometricMedianTopology Phase2 epoch=400/1706 Val=93.36 Test=92.47 best=93.36@400 260621-11:40:23 (UTC+8)260621-11:40:25 (UTC+8)
15817_GeometricMedianTopology Phase2 epoch=300/1706 Val=92.47 Test=91.68 best=92.47@300 260621-11:40:21 (UTC+8)260621-11:40:23 (UTC+8)
15717_GeometricMedianTopology Phase2 epoch=200/1706 Val=91.22 Test=90.62 best=91.22@200 260621-11:40:19 (UTC+8)260621-11:40:21 (UTC+8)
15617_GeometricMedianTopology Phase2 epoch=100/1706 Val=89.30 Test=89.66 best=89.30@100 260621-11:40:17 (UTC+8)260621-11:40:19 (UTC+8)
15517_GeometricMedianTopology Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-11:40:14 (UTC+8)260621-11:40:16 (UTC+8)
15417_GeometricMedianTopology Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-11:40:13 (UTC+8)260621-11:40:15 (UTC+8)
15317_GeometricMedianTopology Phase1 完成:best=94.14@153 targets=19717 260621-11:40:11 (UTC+8)260621-11:40:12 (UTC+8)
15217_GeometricMedianTopology Phase1 epoch=2200/2256 best=94.14@153 260621-11:39:59 (UTC+8)260621-11:39:59 (UTC+8)
15117_GeometricMedianTopology Phase1 epoch=2100/2256 best=94.14@153 260621-11:39:38 (UTC+8)260621-11:39:39 (UTC+8)
15017_GeometricMedianTopology Phase1 epoch=2000/2256 best=94.14@153 260621-11:39:17 (UTC+8)260621-11:39:19 (UTC+8)
14917_GeometricMedianTopology Phase1 epoch=1900/2256 best=94.14@153 260621-11:38:56 (UTC+8)260621-11:38:58 (UTC+8)
14817_GeometricMedianTopology Phase1 epoch=1800/2256 best=94.14@153 260621-11:38:18 (UTC+8)260621-11:38:19 (UTC+8)
14717_GeometricMedianTopology Phase1 epoch=1700/2256 best=94.14@153 260621-11:37:38 (UTC+8)260621-11:37:39 (UTC+8)
14617_GeometricMedianTopology Phase1 epoch=1600/2256 best=94.14@153 260621-11:36:58 (UTC+8)260621-11:37:00 (UTC+8)
14517_GeometricMedianTopology Phase1 epoch=1500/2256 best=94.14@153 260621-11:36:20 (UTC+8)260621-11:36:21 (UTC+8)
14417_GeometricMedianTopology Phase1 epoch=1400/2256 best=94.14@153 260621-11:35:30 (UTC+8)260621-11:35:31 (UTC+8)
14317_GeometricMedianTopology Phase1 epoch=1300/2256 best=94.14@153 260621-11:34:38 (UTC+8)260621-11:34:40 (UTC+8)
14217_GeometricMedianTopology Phase1 epoch=1200/2256 best=94.14@153 260621-11:33:49 (UTC+8)260621-11:33:50 (UTC+8)
14117_GeometricMedianTopology Phase1 epoch=1100/2256 best=94.14@153 260621-11:33:01 (UTC+8)260621-11:33:01 (UTC+8)
14017_GeometricMedianTopology Phase1 epoch=1000/2256 best=94.14@153 260621-11:32:09 (UTC+8)260621-11:32:11 (UTC+8)
13917_GeometricMedianTopology Phase1 epoch=900/2256 best=94.14@153 260621-11:31:20 (UTC+8)260621-11:31:20 (UTC+8)
13817_GeometricMedianTopology Phase1 epoch=800/2256 best=94.14@153 260621-11:30:29 (UTC+8)260621-11:30:30 (UTC+8)
13717_GeometricMedianTopology Phase1 epoch=700/2256 best=94.14@153 260621-11:29:39 (UTC+8)260621-11:29:40 (UTC+8)
13617_GeometricMedianTopology Phase1 epoch=600/2256 best=94.14@153 260621-11:28:47 (UTC+8)260621-11:28:49 (UTC+8)
13517_GeometricMedianTopology Phase1 epoch=400/2256 best=94.14@153 260621-11:27:02 (UTC+8)260621-11:27:04 (UTC+8)
13417_GeometricMedianTopology Phase1 epoch=300/2256 best=94.14@153 260621-11:26:11 (UTC+8)260621-11:26:12 (UTC+8)
13317_GeometricMedianTopology Phase1 epoch=200/2256 best=94.14@153 260621-11:25:20 (UTC+8)260621-11:25:21 (UTC+8)
13217_GeometricMedianTopology Phase1 epoch=100/2256 best=93.94@56 260621-11:24:29 (UTC+8)260621-11:24:30 (UTC+8)
13117_GeometricMedianTopology Phase1 epoch=1/2256 best=39.67@1 260621-11:23:41 (UTC+8)260621-11:23:43 (UTC+8)
13017_GeometricMedianTopology Phase1 启动:Robust topology center by cross-K geometric median 260621-11:23:40 (UTC+8)260621-11:23:42 (UTC+8)
12917_GeometricMedianTopology 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=1 260621-11:23:35 (UTC+8)260621-11:23:36 (UTC+8)
12815_UncertaintyWeightedAggregation 完成:Val=94.60 Test=93.48 MLP=91.78 GNN=92.06 260621-11:23:30 (UTC+8)260621-11:23:31 (UTC+8)
12715_UncertaintyWeightedAggregation Phase2 完成:Val=94.60 Test=93.48 best_epoch=1600 260621-11:23:29 (UTC+8)260621-11:23:30 (UTC+8)
12615_UncertaintyWeightedAggregation Phase2 epoch=1700/1706 Val=94.17 Test=93.36 best=94.60@1600 260621-11:23:28 (UTC+8)260621-11:23:29 (UTC+8)
12515_UncertaintyWeightedAggregation Phase2 epoch=1600/1706 Val=94.60 Test=93.48 best=94.60@1600 260621-11:23:26 (UTC+8)260621-11:23:27 (UTC+8)
12415_UncertaintyWeightedAggregation Phase2 epoch=1500/1706 Val=94.14 Test=93.33 best=94.50@1040 260621-11:23:20 (UTC+8)260621-11:23:21 (UTC+8)
12315_UncertaintyWeightedAggregation Phase2 epoch=1400/1706 Val=94.17 Test=93.26 best=94.50@1040 260621-11:23:11 (UTC+8)260621-11:23:13 (UTC+8)
12215_UncertaintyWeightedAggregation Phase2 epoch=1300/1706 Val=94.14 Test=93.69 best=94.50@1040 260621-11:23:03 (UTC+8)260621-11:23:04 (UTC+8)
12115_UncertaintyWeightedAggregation Phase2 epoch=1200/1706 Val=94.27 Test=93.18 best=94.50@1040 260621-11:22:55 (UTC+8)260621-11:22:56 (UTC+8)
12015_UncertaintyWeightedAggregation Phase2 epoch=1100/1706 Val=94.04 Test=93.48 best=94.50@1040 260621-11:22:47 (UTC+8)260621-11:22:48 (UTC+8)
11915_UncertaintyWeightedAggregation Phase2 epoch=1000/1706 Val=93.96 Test=93.64 best=94.29@795 260621-11:22:37 (UTC+8)260621-11:22:39 (UTC+8)
11815_UncertaintyWeightedAggregation Phase2 epoch=900/1706 Val=93.66 Test=93.56 best=94.29@795 260621-11:22:30 (UTC+8)260621-11:22:31 (UTC+8)
11715_UncertaintyWeightedAggregation Phase2 epoch=800/1706 Val=94.17 Test=93.61 best=94.29@795 260621-11:22:21 (UTC+8)260621-11:22:23 (UTC+8)
11615_UncertaintyWeightedAggregation Phase2 epoch=700/1706 Val=93.89 Test=93.36 best=94.12@620 260621-11:22:14 (UTC+8)260621-11:22:15 (UTC+8)
11515_UncertaintyWeightedAggregation Phase2 epoch=600/1706 Val=93.96 Test=93.43 best=94.09@560 260621-11:22:04 (UTC+8)260621-11:22:06 (UTC+8)
11415_UncertaintyWeightedAggregation Phase2 epoch=500/1706 Val=93.89 Test=93.10 best=93.96@490 260621-11:21:56 (UTC+8)260621-11:21:58 (UTC+8)
11315_UncertaintyWeightedAggregation Phase2 epoch=400/1706 Val=93.61 Test=92.98 best=93.61@400 260621-11:21:48 (UTC+8)260621-11:21:50 (UTC+8)
11215_UncertaintyWeightedAggregation Phase2 epoch=300/1706 Val=92.32 Test=92.17 best=92.62@285 260621-11:21:40 (UTC+8)260621-11:21:41 (UTC+8)
11115_UncertaintyWeightedAggregation Phase2 epoch=200/1706 Val=91.61 Test=90.97 best=91.61@200 260621-11:21:32 (UTC+8)260621-11:21:33 (UTC+8)
11015_UncertaintyWeightedAggregation Phase2 epoch=100/1706 Val=89.58 Test=90.06 best=89.60@95 260621-11:21:23 (UTC+8)260621-11:21:25 (UTC+8)
10915_UncertaintyWeightedAggregation Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-11:21:15 (UTC+8)260621-11:21:16 (UTC+8)
10815_UncertaintyWeightedAggregation Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-11:21:14 (UTC+8)260621-11:21:15 (UTC+8)
10715_UncertaintyWeightedAggregation Phase1 完成:best=94.09@152 targets=19717 260621-11:20:59 (UTC+8)260621-11:21:00 (UTC+8)
10615_UncertaintyWeightedAggregation Phase1 epoch=2200/2256 best=94.09@152 260621-11:20:35 (UTC+8)260621-11:20:37 (UTC+8)
10515_UncertaintyWeightedAggregation Phase1 epoch=2100/2256 best=94.09@152 260621-11:19:56 (UTC+8)260621-11:19:57 (UTC+8)
10415_UncertaintyWeightedAggregation Phase1 epoch=2000/2256 best=94.09@152 260621-11:19:17 (UTC+8)260621-11:19:18 (UTC+8)
10315_UncertaintyWeightedAggregation Phase1 epoch=1900/2256 best=94.09@152 260621-11:18:36 (UTC+8)260621-11:18:38 (UTC+8)
10215_UncertaintyWeightedAggregation Phase1 epoch=1800/2256 best=94.09@152 260621-11:17:57 (UTC+8)260621-11:17:58 (UTC+8)
10115_UncertaintyWeightedAggregation Phase1 epoch=1700/2256 best=94.09@152 260621-11:17:17 (UTC+8)260621-11:17:19 (UTC+8)
10015_UncertaintyWeightedAggregation Phase1 epoch=1600/2256 best=94.09@152 260621-11:16:38 (UTC+8)260621-11:16:39 (UTC+8)
9915_UncertaintyWeightedAggregation Phase1 epoch=1500/2256 best=94.09@152 260621-11:15:59 (UTC+8)260621-11:16:00 (UTC+8)
9815_UncertaintyWeightedAggregation Phase1 epoch=1400/2256 best=94.09@152 260621-11:15:08 (UTC+8)260621-11:15:10 (UTC+8)
9715_UncertaintyWeightedAggregation Phase1 epoch=1300/2256 best=94.09@152 260621-11:14:18 (UTC+8)260621-11:14:19 (UTC+8)
9615_UncertaintyWeightedAggregation Phase1 epoch=1200/2256 best=94.09@152 260621-11:13:28 (UTC+8)260621-11:13:29 (UTC+8)
9515_UncertaintyWeightedAggregation Phase1 epoch=1100/2256 best=94.09@152 260621-11:12:37 (UTC+8)260621-11:12:39 (UTC+8)
9415_UncertaintyWeightedAggregation Phase1 epoch=1000/2256 best=94.09@152 260621-11:11:47 (UTC+8)260621-11:11:48 (UTC+8)
9315_UncertaintyWeightedAggregation Phase1 epoch=900/2256 best=94.09@152 260621-11:10:57 (UTC+8)260621-11:10:57 (UTC+8)
9215_UncertaintyWeightedAggregation Phase1 epoch=800/2256 best=94.09@152 260621-11:10:05 (UTC+8)260621-11:10:06 (UTC+8)
9115_UncertaintyWeightedAggregation Phase1 epoch=700/2256 best=94.09@152 260621-11:09:14 (UTC+8)260621-11:09:15 (UTC+8)
9015_UncertaintyWeightedAggregation Phase1 epoch=600/2256 best=94.09@152 260621-11:08:37 (UTC+8)260621-11:08:39 (UTC+8)
8915_UncertaintyWeightedAggregation Phase1 epoch=500/2256 best=94.09@152 260621-11:08:11 (UTC+8)260621-11:08:12 (UTC+8)
8815_UncertaintyWeightedAggregation Phase1 epoch=400/2256 best=94.09@152 260621-11:07:44 (UTC+8)260621-11:07:45 (UTC+8)
8715_UncertaintyWeightedAggregation Phase1 epoch=300/2256 best=94.09@152 260621-11:07:17 (UTC+8)260621-11:07:18 (UTC+8)
8615_UncertaintyWeightedAggregation Phase1 epoch=200/2256 best=94.09@152 260621-11:06:01 (UTC+8)260621-11:06:51 (UTC+8)
8515_UncertaintyWeightedAggregation Phase1 epoch=100/2256 best=93.94@56 260621-11:05:35 (UTC+8)260621-11:06:25 (UTC+8)
8415_UncertaintyWeightedAggregation Phase1 epoch=1/2256 best=39.67@1 260621-11:05:10 (UTC+8)260621-11:05:58 (UTC+8)
8315_UncertaintyWeightedAggregation Phase1 启动:Uncertainty-gated topology aggregation 260621-11:05:09 (UTC+8)260621-11:05:57 (UTC+8)
8215_UncertaintyWeightedAggregation 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=1 260621-11:05:03 (UTC+8)260621-11:05:51 (UTC+8)
8114_KMLPSoftmaxAggregation 完成:Val=94.80 Test=93.48 MLP=91.76 GNN=92.65 260621-11:04:59 (UTC+8)260621-11:05:47 (UTC+8)
8014_KMLPSoftmaxAggregation Phase2 完成:Val=94.80 Test=93.48 best_epoch=1695 260621-11:04:58 (UTC+8)260621-11:05:46 (UTC+8)
7914_KMLPSoftmaxAggregation Phase2 epoch=1700/1706 Val=93.08 Test=92.62 best=94.80@1695 260621-11:04:57 (UTC+8)260621-11:05:45 (UTC+8)
7814_KMLPSoftmaxAggregation Phase2 epoch=1600/1706 Val=94.50 Test=93.33 best=94.78@1555 260621-11:04:55 (UTC+8)260621-11:05:43 (UTC+8)
7714_KMLPSoftmaxAggregation Phase2 epoch=1500/1706 Val=94.37 Test=93.74 best=94.57@1495 260621-11:04:53 (UTC+8)260621-11:05:40 (UTC+8)
7614_KMLPSoftmaxAggregation Phase2 epoch=1400/1706 Val=94.22 Test=93.66 best=94.52@1125 260621-11:04:51 (UTC+8)260621-11:05:38 (UTC+8)
7514_KMLPSoftmaxAggregation Phase2 epoch=1300/1706 Val=94.24 Test=93.66 best=94.52@1125 260621-11:04:49 (UTC+8)260621-11:05:36 (UTC+8)
7414_KMLPSoftmaxAggregation Phase2 epoch=1200/1706 Val=94.34 Test=93.69 best=94.52@1125 260621-11:04:47 (UTC+8)260621-11:05:34 (UTC+8)
7314_KMLPSoftmaxAggregation Phase2 epoch=1100/1706 Val=93.81 Test=93.38 best=94.47@730 260621-11:04:45 (UTC+8)260621-11:05:32 (UTC+8)
7214_KMLPSoftmaxAggregation Phase2 epoch=1000/1706 Val=94.12 Test=93.18 best=94.47@730 260621-11:04:43 (UTC+8)260621-11:05:30 (UTC+8)
7114_KMLPSoftmaxAggregation Phase2 epoch=900/1706 Val=94.32 Test=93.51 best=94.47@730 260621-11:04:41 (UTC+8)260621-11:05:27 (UTC+8)
7014_KMLPSoftmaxAggregation Phase2 epoch=800/1706 Val=93.99 Test=92.93 best=94.47@730 260621-11:04:39 (UTC+8)260621-11:05:26 (UTC+8)
6914_KMLPSoftmaxAggregation Phase2 epoch=700/1706 Val=93.69 Test=93.20 best=94.42@645 260621-11:04:37 (UTC+8)260621-11:05:23 (UTC+8)
6814_KMLPSoftmaxAggregation Phase2 epoch=600/1706 Val=93.05 Test=93.05 best=94.09@550 260621-11:04:34 (UTC+8)260621-11:05:21 (UTC+8)
6714_KMLPSoftmaxAggregation Phase2 epoch=400/1706 Val=93.58 Test=92.90 best=93.58@400 260621-11:04:21 (UTC+8)260621-11:05:07 (UTC+8)
6614_KMLPSoftmaxAggregation Phase2 epoch=300/1706 Val=92.87 Test=91.78 best=92.92@295 260621-11:04:15 (UTC+8)260621-11:05:01 (UTC+8)
6514_KMLPSoftmaxAggregation Phase2 epoch=200/1706 Val=91.38 Test=91.28 best=91.94@195 260621-11:04:07 (UTC+8)260621-11:04:53 (UTC+8)
6414_KMLPSoftmaxAggregation Phase2 epoch=100/1706 Val=89.53 Test=89.73 best=89.53@100 260621-11:03:59 (UTC+8)260621-11:04:45 (UTC+8)
6314_KMLPSoftmaxAggregation Phase2 epoch=1/1706 Val=21.13 Test=20.59 best=21.13@1 260621-11:03:51 (UTC+8)260621-11:04:36 (UTC+8)
6214_KMLPSoftmaxAggregation Phase2 启动:distill_nodes=19717 alpha_d=67.28612026553618 260621-11:03:51 (UTC+8)260621-11:04:35 (UTC+8)
6114_KMLPSoftmaxAggregation Phase1 完成:best=94.09@159 targets=19717 260621-11:03:32 (UTC+8)260621-11:04:16 (UTC+8)
6014_KMLPSoftmaxAggregation Phase1 epoch=2200/2256 best=94.09@159 260621-11:03:08 (UTC+8)260621-11:03:51 (UTC+8)
5914_KMLPSoftmaxAggregation Phase1 epoch=2100/2256 best=94.09@159 260621-11:02:30 (UTC+8)260621-11:03:12 (UTC+8)
5814_KMLPSoftmaxAggregation Phase1 epoch=2000/2256 best=94.09@159 260621-11:01:53 (UTC+8)260621-11:02:33 (UTC+8)
5714_KMLPSoftmaxAggregation Phase1 epoch=1900/2256 best=94.09@159 260621-11:01:15 (UTC+8)260621-11:01:53 (UTC+8)
5614_KMLPSoftmaxAggregation Phase1 epoch=1800/2256 best=94.09@159 260621-11:00:30 (UTC+8)260621-11:01:15 (UTC+8)
5514_KMLPSoftmaxAggregation Phase1 epoch=200/2256 best=94.09@159 260621-10:45:30 (UTC+8)260621-10:45:28 (UTC+8)
5414_KMLPSoftmaxAggregation Phase1 epoch=1/2256 best=39.67@1 260621-10:43:32 (UTC+8)260621-10:43:37 (UTC+8)
5314_KMLPSoftmaxAggregation Phase1 启动:K-dimension MLP softmax aggregation 260621-10:43:30 (UTC+8)260621-10:43:35 (UTC+8)
5200_FullBestReplay 完成:Val=94.14 Test=92.57 MLP=91.89 GNN=90.95 260621-10:43:14 (UTC+8)260621-10:43:19 (UTC+8)
5100_FullBestReplay Phase2 epoch=1700/1706 Val=92.49 Test=91.68 best=94.14@1470 260621-10:42:59 (UTC+8)260621-10:43:07 (UTC+8)
5000_FullBestReplay Phase2 epoch=1400/1706 Val=93.91 Test=92.29 best=93.99@1355 260621-10:42:11 (UTC+8)260621-10:42:16 (UTC+8)
4900_FullBestReplay Phase2 epoch=800/1706 Val=93.48 Test=92.85 best=93.56@795 260621-10:41:03 (UTC+8)260621-10:41:01 (UTC+8)
4800_FullBestReplay Phase2 epoch=500/1706 Val=92.06 Test=91.71 best=92.70@475 260621-10:40:08 (UTC+8)260621-10:40:20 (UTC+8)
4700_FullBestReplay Phase2 epoch=400/1706 Val=92.19 Test=91.94 best=92.57@380 260621-10:39:59 (UTC+8)260621-10:40:06 (UTC+8)
4600_FullBestReplay Phase2 epoch=100/1706 Val=88.92 Test=89.55 best=88.92@100 260621-10:39:26 (UTC+8)260621-10:39:30 (UTC+8)
4500_FullBestReplay Phase1 完成:best=94.07@153 targets=19717 260621-10:38:53 (UTC+8)260621-10:38:57 (UTC+8)
4400_FullBestReplay Phase1 epoch=2100/2256 best=94.07@153 260621-10:37:39 (UTC+8)260621-10:37:40 (UTC+8)
4300_FullBestReplay Phase1 epoch=2000/2256 best=94.07@153 260621-10:37:01 (UTC+8)260621-10:37:01 (UTC+8)
4200_FullBestReplay Phase1 epoch=1800/2256 best=94.07@153 260621-10:35:28 (UTC+8)260621-10:35:30 (UTC+8)
4100_FullBestReplay Phase1 epoch=900/2256 best=94.07@153 260621-10:27:43 (UTC+8)260621-10:27:47 (UTC+8)
4000_FullBestReplay Phase1 epoch=800/2256 best=94.07@153 260621-10:26:57 (UTC+8)260621-10:26:58 (UTC+8)
3900_FullBestReplay Phase1 epoch=700/2256 best=94.07@153 260621-10:26:03 (UTC+8)260621-10:26:08 (UTC+8)
3800_FullBestReplay Phase1 epoch=600/2256 best=94.07@153 260621-10:25:16 (UTC+8)260621-10:25:19 (UTC+8)
3700_FullBestReplay Phase1 epoch=100/2256 best=93.94@56 260621-10:20:37 (UTC+8)260621-10:20:52 (UTC+8)
3600_FullBestReplay Phase1 epoch=1/2256 best=39.67@1 260621-10:19:50 (UTC+8)260621-10:20:03 (UTC+8)
3500_FullBestReplay Phase1 启动:Full latest PubMed replay 260621-10:19:49 (UTC+8)260621-10:20:02 (UTC+8)
3400_FullBestReplay 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=1 260621-10:19:42 (UTC+8)260621-10:19:55 (UTC+8)
33P4 K2M2 完成:prompts=41704 nodes=19717 K=[1,2] M=[1,2] 260621-10:19:37 (UTC+8)260621-10:19:50 (UTC+8)
32P4 K2M2 extracting:batch=41704/41704 prompts=41704/41704 260621-10:19:31 (UTC+8)260621-10:19:44 (UTC+8)
31P4 K2M2 extracting:batch=38000/41704 prompts=38000/41704 260621-10:02:53 (UTC+8)260621-10:03:03 (UTC+8)
30P4 K2M2 extracting:batch=37000/41704 prompts=37000/41704 260621-09:59:32 (UTC+8)260621-09:59:33 (UTC+8)
29P4 K2M2 extracting:batch=35000/41704 prompts=35000/41704 260621-09:52:25 (UTC+8)260621-09:52:26 (UTC+8)
28P4 K2M2 extracting:batch=34000/41704 prompts=34000/41704 260621-09:48:58 (UTC+8)260621-09:49:00 (UTC+8)
27P4 K2M2 extracting:batch=33000/41704 prompts=33000/41704 260621-09:45:25 (UTC+8)260621-09:45:27 (UTC+8)
26P4 K2M2 extracting:batch=32000/41704 prompts=32000/41704 260621-09:41:56 (UTC+8)260621-09:41:59 (UTC+8)
25P4 K2M2 extracting:batch=27000/41704 prompts=27000/41704 260621-09:17:51 (UTC+8)260621-09:20:09 (UTC+8)
24P4 K2M2 extracting:batch=20000/41704 prompts=20000/41704 260621-08:43:17 (UTC+8)260621-08:44:08 (UTC+8)
23P4 K2M2 extracting:batch=19000/41704 prompts=19000/41704 260621-08:38:18 (UTC+8)260621-08:38:57 (UTC+8)
22P4 K2M2 extracting:batch=18000/41704 prompts=18000/41704 260621-08:33:26 (UTC+8)260621-08:33:53 (UTC+8)
21P4 K2M2 extracting:batch=17000/41704 prompts=17000/41704 260621-08:28:40 (UTC+8)260621-08:28:54 (UTC+8)
20P4 K2M2 extracting:batch=16000/41704 prompts=16000/41704 260621-08:23:45 (UTC+8)260621-08:23:47 (UTC+8)
19P4 K2M2 extracting:batch=15000/41704 prompts=15000/41704 260621-08:18:47 (UTC+8)260621-08:18:48 (UTC+8)
18P4 K2M2 extracting:batch=14000/41704 prompts=14000/41704 260621-08:13:38 (UTC+8)260621-08:13:40 (UTC+8)
17P4 K2M2 extracting:batch=13000/41704 prompts=13000/41704 260621-08:08:38 (UTC+8)260621-08:08:40 (UTC+8)
16P4 K2M2 extracting:batch=12000/41704 prompts=12000/41704 260621-08:03:33 (UTC+8)260621-08:03:35 (UTC+8)
15P4 K2M2 extracting:batch=11000/41704 prompts=11000/41704 260621-07:58:43 (UTC+8)260621-07:58:44 (UTC+8)
14P4 K2M2 extracting:batch=10000/41704 prompts=10000/41704 260621-07:55:15 (UTC+8)260621-07:55:16 (UTC+8)
13P4 K2M2 extracting:batch=9000/41704 prompts=9000/41704 260621-07:51:47 (UTC+8)260621-07:51:47 (UTC+8)
12P4 K2M2 extracting:batch=8000/41704 prompts=8000/41704 260621-07:48:23 (UTC+8)260621-07:48:24 (UTC+8)
11P4 K2M2 extracting:batch=7000/41704 prompts=7000/41704 260621-07:45:01 (UTC+8)260621-07:45:02 (UTC+8)
10P4 K2M2 extracting:batch=6000/41704 prompts=6000/41704 260621-07:41:35 (UTC+8)260621-07:41:36 (UTC+8)
9P4 K2M2 extracting:batch=5000/41704 prompts=5000/41704 260621-07:37:17 (UTC+8)260621-07:38:13 (UTC+8)
8P4 K2M2 extracting:batch=4000/41704 prompts=4000/41704 260621-07:33:57 (UTC+8)260621-07:34:46 (UTC+8)
7P4 K2M2 extracting:batch=3000/41704 prompts=3000/41704 260621-07:30:41 (UTC+8)260621-07:31:21 (UTC+8)
6P4 K2M2 extracting:batch=2000/41704 prompts=2000/41704 260621-07:27:22 (UTC+8)260621-07:27:54 (UTC+8)
5P4 K2M2 extracting:batch=1000/41704 prompts=1000/41704 260621-07:24:03 (UTC+8)260621-07:24:27 (UTC+8)
4P4 K2M2 extracting:batch=1/41704 prompts=1/41704 260621-07:20:43 (UTC+8)260621-07:20:59 (UTC+8)
3P4 K2M2 model loaded:layer=21/32 hidden=4096 260621-07:20:40 (UTC+8)260621-07:20:55 (UTC+8)
2P4 K2M2 plan ready:prompts=41704 nodes=19717 260621-07:20:34 (UTC+8)260621-07:20:49 (UTC+8)
1P4 K2M2 bank 启动:root=/media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Pubmed_9999 output=/media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Pubmed_9999/embedding_bank batch=1 260621-07:20:30 (UTC+8)260621-07:20:45 (UTC+8)
#05

PubMed6666RemainingAblations

▦ table
last update
260621-01:36:39
records
5
type
text
latest
remaining matrix 失败:code=1 260621-01:36:06 (UTC+8)
ID数值接收时间
5remaining matrix 失败:code=1 260621-01:36:06 (UTC+8)260621-01:36:39 (UTC+8)
401_TaskOnly failed:FileNotFoundError(2, 'No such file or directory') 260621-01:36:04 (UTC+8)260621-01:36:37 (UTC+8)
301_TaskOnly 启动:device=cuda:0 CUDA_VISIBLE_DEVICES=0 260621-01:36:03 (UTC+8)260621-01:36:36 (UTC+8)
2主流程已结束,开始追加 01-13 标准矩阵消融 260621-01:35:59 (UTC+8)260621-01:36:32 (UTC+8)
1remaining matrix watcher 已启动:等待主流程 PID=2585998 260620-12:50:53 (UTC+8)260620-12:50:55 (UTC+8)
#06

Wiki-CS6666Orthrus

▦ table
last update
260619-16:11:16
records
519
type
text
latest
P5 Phase1-only cache ready: /media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Wiki-CS_6666/Data_Cache/phase1_cache_wikics_bestVal.pt 260619-16:11:16 (UTC+8)
ID数值接收时间
519P5 Phase1-only cache ready: /media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Wiki-CS_6666/Data_Cache/phase1_cache_wikics_bestVal.pt 260619-16:11:16 (UTC+8)260619-16:11:16 (UTC+8)
518P5 Phase1 完成:best_val_probe_acc=86.65@600 cache=phase1_cache_wikics_bestVal.pt 260619-16:11:15 (UTC+8)260619-16:11:16 (UTC+8)
517P5 Phase1 epoch=600/600 val_probe_acc=86.65 best=86.65@600 260619-16:11:13 (UTC+8)260619-16:11:14 (UTC+8)
516P5 Phase1 epoch=575/600 val_probe_acc=86.60 best=86.60@575 260619-16:11:05 (UTC+8)260619-16:11:07 (UTC+8)
515P5 Phase1 epoch=500/600 val_probe_acc=86.58 best=86.58@500 260619-16:10:48 (UTC+8)260619-16:10:48 (UTC+8)
514P5 Phase1 epoch=450/600 val_probe_acc=86.51 best=86.51@450 260619-16:10:35 (UTC+8)260619-16:10:36 (UTC+8)
513P5 Phase1 epoch=425/600 val_probe_acc=86.36 best=86.36@425 260619-16:10:29 (UTC+8)260619-16:10:30 (UTC+8)
512P5 Phase1 epoch=400/600 val_probe_acc=85.91 best=85.91@400 260619-16:10:22 (UTC+8)260619-16:10:23 (UTC+8)
511P5 Phase1 epoch=375/600 val_probe_acc=85.64 best=85.64@375 260619-16:10:16 (UTC+8)260619-16:10:17 (UTC+8)
510P5 Phase1 epoch=300/600 val_probe_acc=85.56 best=85.56@300 260619-16:09:58 (UTC+8)260619-16:09:59 (UTC+8)
509P5 Phase1 epoch=275/600 val_probe_acc=85.21 best=85.21@275 260619-16:09:51 (UTC+8)260619-16:09:53 (UTC+8)
508P5 Phase1 epoch=250/600 val_probe_acc=85.17 best=85.17@250 260619-16:09:45 (UTC+8)260619-16:09:46 (UTC+8)
507P5 Phase1 epoch=225/600 val_probe_acc=84.86 best=84.86@225 260619-16:09:39 (UTC+8)260619-16:09:40 (UTC+8)
506P5 Phase1 epoch=200/600 val_probe_acc=84.71 best=84.71@200 260619-16:09:32 (UTC+8)260619-16:09:33 (UTC+8)
505P5 Phase1 epoch=175/600 val_probe_acc=83.85 best=83.85@175 260619-16:09:24 (UTC+8)260619-16:09:26 (UTC+8)
504P5 Phase1 epoch=150/600 val_probe_acc=83.65 best=83.65@150 260619-16:09:19 (UTC+8)260619-16:09:20 (UTC+8)
503P5 Phase1 epoch=100/600 val_probe_acc=82.14 best=82.14@100 260619-16:09:07 (UTC+8)260619-16:09:08 (UTC+8)
502P5 Phase1 epoch=75/600 val_probe_acc=77.80 best=77.80@75 260619-16:09:01 (UTC+8)260619-16:09:02 (UTC+8)
501P5 Phase1 epoch=50/600 val_probe_acc=67.16 best=67.16@50 260619-16:08:55 (UTC+8)260619-16:08:56 (UTC+8)
500P5 Phase1 epoch=25/600 val_probe_acc=53.86 best=53.86@25 260619-16:08:47 (UTC+8)260619-16:08:49 (UTC+8)
499P5 Phase1 epoch=1/600 val_probe_acc=22.56 best=22.56@1 260619-16:08:42 (UTC+8)260619-16:08:43 (UTC+8)
498P5 Phase1 启动:三力解耦 L26 mean_last32 KM bank,按 best-val 保存 cache 260619-16:08:39 (UTC+8)260619-16:08:40 (UTC+8)
497P5 Phase1-only cache build start: seed=3047 epochs=600 device=cuda:0 260619-16:08:38 (UTC+8)260619-16:08:39 (UTC+8)
496P3 完成:KM bank sanity valid_mean=4.00 norm_mean=8.47 260619-16:08:34 (UTC+8)260619-16:08:35 (UTC+8)
495P3 启动:检查 L26 mean_last32 KM hidden bank 260619-16:08:32 (UTC+8)260619-16:08:33 (UTC+8)
494P4 完成:L26 mean_last32 KM bank 已写入 embedding_bank,hidden_dim=4096 260619-16:08:27 (UTC+8)260619-16:08:27 (UTC+8)
493P4 hidden 提取进度:46804/46804 prompts 260619-16:08:21 (UTC+8)260619-16:08:21 (UTC+8)
492P4 hidden 提取进度:46000/46804 prompts 260619-16:03:18 (UTC+8)260619-16:03:19 (UTC+8)
491P4 hidden 提取进度:45000/46804 prompts 260619-15:54:39 (UTC+8)260619-15:54:40 (UTC+8)
490P4 hidden 提取进度:44000/46804 prompts 260619-15:46:08 (UTC+8)260619-15:46:10 (UTC+8)
489P4 hidden 提取进度:43000/46804 prompts 260619-15:37:42 (UTC+8)260619-15:37:43 (UTC+8)
488P4 hidden 提取进度:42000/46804 prompts 260619-15:29:04 (UTC+8)260619-15:29:05 (UTC+8)
487P4 hidden 提取进度:41000/46804 prompts 260619-15:21:21 (UTC+8)260619-15:21:22 (UTC+8)
486P4 hidden 提取进度:40000/46804 prompts 260619-15:12:41 (UTC+8)260619-15:12:41 (UTC+8)
485P4 hidden 提取进度:39000/46804 prompts 260619-15:04:15 (UTC+8)260619-15:04:16 (UTC+8)
484P4 hidden 提取进度:38000/46804 prompts 260619-14:55:52 (UTC+8)260619-14:55:54 (UTC+8)
483P4 hidden 提取进度:37000/46804 prompts 260619-14:47:28 (UTC+8)260619-14:47:30 (UTC+8)
482P4 hidden 提取进度:36000/46804 prompts 260619-14:39:16 (UTC+8)260619-14:39:18 (UTC+8)
481P4 hidden 提取进度:35000/46804 prompts 260619-14:30:47 (UTC+8)260619-14:30:49 (UTC+8)
480P4 hidden 提取进度:34000/46804 prompts 260619-14:21:34 (UTC+8)260619-14:21:35 (UTC+8)
479P4 hidden 提取进度:33000/46804 prompts 260619-14:12:58 (UTC+8)260619-14:12:59 (UTC+8)
478P4 hidden 提取进度:32000/46804 prompts 260619-14:03:55 (UTC+8)260619-14:03:57 (UTC+8)
477P4 hidden 提取进度:31000/46804 prompts 260619-13:54:47 (UTC+8)260619-13:54:48 (UTC+8)
476P4 hidden 提取进度:30000/46804 prompts 260619-13:45:56 (UTC+8)260619-13:45:56 (UTC+8)
475P4 hidden 提取进度:29000/46804 prompts 260619-13:37:29 (UTC+8)260619-13:37:29 (UTC+8)
474P4 hidden 提取进度:28000/46804 prompts 260619-13:28:21 (UTC+8)260619-13:28:22 (UTC+8)
473P4 hidden 提取进度:27000/46804 prompts 260619-13:18:30 (UTC+8)260619-13:19:21 (UTC+8)
472P4 hidden 提取进度:26000/46804 prompts 260619-13:10:00 (UTC+8)260619-13:10:30 (UTC+8)
471P4 hidden 提取进度:25000/46804 prompts 260619-13:01:33 (UTC+8)260619-13:01:43 (UTC+8)
470P4 hidden 提取进度:24000/46804 prompts 260619-12:52:48 (UTC+8)260619-12:52:49 (UTC+8)
469P4 hidden 提取进度:23000/46804 prompts 260619-12:44:03 (UTC+8)260619-12:44:04 (UTC+8)
468P4 hidden 提取进度:22000/46804 prompts 260619-12:35:44 (UTC+8)260619-12:35:45 (UTC+8)
467P4 hidden 提取进度:21000/46804 prompts 260619-12:27:22 (UTC+8)260619-12:27:24 (UTC+8)
466P4 hidden 提取进度:20000/46804 prompts 260619-12:18:56 (UTC+8)260619-12:18:57 (UTC+8)
465P4 hidden 提取进度:19000/46804 prompts 260619-12:10:16 (UTC+8)260619-12:10:18 (UTC+8)
464P4 hidden 提取进度:18000/46804 prompts 260619-12:02:00 (UTC+8)260619-12:02:01 (UTC+8)
463P4 hidden 提取进度:17000/46804 prompts 260619-11:53:37 (UTC+8)260619-11:53:38 (UTC+8)
462P4 hidden 提取进度:16000/46804 prompts 260619-11:45:19 (UTC+8)260619-11:45:21 (UTC+8)
461P4 hidden 提取进度:15000/46804 prompts 260619-11:37:07 (UTC+8)260619-11:37:08 (UTC+8)
460P4 hidden 提取进度:14000/46804 prompts 260619-11:28:53 (UTC+8)260619-11:28:53 (UTC+8)
459P4 hidden 提取进度:13000/46804 prompts 260619-11:20:01 (UTC+8)260619-11:20:02 (UTC+8)
458P4 hidden 提取进度:12000/46804 prompts 260619-11:12:11 (UTC+8)260619-11:12:13 (UTC+8)
457P4 hidden 提取进度:11000/46804 prompts 260619-11:03:20 (UTC+8)260619-11:03:20 (UTC+8)
456P4 hidden 提取进度:10000/46804 prompts 260619-10:54:04 (UTC+8)260619-10:54:05 (UTC+8)
455P4 hidden 提取进度:9000/46804 prompts 260619-10:45:35 (UTC+8)260619-10:45:36 (UTC+8)
454P4 hidden 提取进度:8000/46804 prompts 260619-10:36:30 (UTC+8)260619-10:36:31 (UTC+8)
453P4 hidden 提取进度:7000/46804 prompts 260619-10:27:30 (UTC+8)260619-10:27:32 (UTC+8)
452P4 hidden 提取进度:6000/46804 prompts 260619-10:18:37 (UTC+8)260619-10:18:38 (UTC+8)
451P4 hidden 提取进度:5000/46804 prompts 260619-10:10:02 (UTC+8)260619-10:10:03 (UTC+8)
450P4 hidden 提取进度:4000/46804 prompts 260619-10:01:08 (UTC+8)260619-10:01:09 (UTC+8)
449P4 hidden 提取进度:3000/46804 prompts 260619-09:52:13 (UTC+8)260619-09:52:14 (UTC+8)
448P4 hidden 提取进度:2000/46804 prompts 260619-09:43:34 (UTC+8)260619-09:43:35 (UTC+8)
447P4 hidden 提取进度:1000/46804 prompts 260619-09:34:36 (UTC+8)260619-09:34:38 (UTC+8)
446P4 hidden 提取进度:1/46804 prompts 260619-09:24:53 (UTC+8)260619-09:25:50 (UTC+8)
445P4 启动:加载 LoRA 生成 KM hidden bank | adapter=SFT_LoRA_Adapters_1781747659530384432 layer=L26 pool=mean_last32 260619-09:24:45 (UTC+8)260619-09:25:41 (UTC+8)
444P2 完成:SFT/P4 格式一致性通过 adapter=SFT_LoRA_Adapters_1781747659530384432 260619-09:24:40 (UTC+8)260619-09:25:37 (UTC+8)
443P2 启动:核对 SFT/P4 Alpaca 格式和安全截断 260619-09:24:39 (UTC+8)260619-09:25:35 (UTC+8)
442P1 完成:LLM SFT adapter=SFT_LoRA_Adapters_1781747659530384432 samples=35000 260619-09:24:33 (UTC+8)260619-09:25:28 (UTC+8)
441P1 SFT checkpoint:step=4376 epoch=2.000 260619-09:24:31 (UTC+8)260619-09:25:27 (UTC+8)
440P1 SFT step=4370/4376 epoch=1.997 loss=0.3491 260619-09:22:27 (UTC+8)260619-09:23:18 (UTC+8)
439P1 SFT step=4360/4376 epoch=1.993 loss=0.3615 260619-09:19:02 (UTC+8)260619-09:19:44 (UTC+8)
438P1 SFT step=4350/4376 epoch=1.988 loss=0.3481 260619-09:15:48 (UTC+8)260619-09:16:22 (UTC+8)
437P1 SFT step=4340/4376 epoch=1.984 loss=0.3467 260619-09:12:04 (UTC+8)260619-09:12:29 (UTC+8)
436P1 SFT step=4330/4376 epoch=1.979 loss=0.4029 260619-09:08:20 (UTC+8)260619-09:08:35 (UTC+8)
435P1 SFT step=4320/4376 epoch=1.975 loss=0.3565 260619-09:04:45 (UTC+8)260619-09:04:51 (UTC+8)
434P1 SFT step=4310/4376 epoch=1.970 loss=0.3955 260619-09:00:58 (UTC+8)260619-09:01:00 (UTC+8)
433P1 SFT step=4300/4376 epoch=1.965 loss=0.3677 260619-08:57:16 (UTC+8)260619-08:57:18 (UTC+8)
432P1 SFT step=4290/4376 epoch=1.961 loss=0.3919 260619-08:53:40 (UTC+8)260619-08:53:42 (UTC+8)
431P1 SFT step=4280/4376 epoch=1.956 loss=0.3717 260619-08:49:48 (UTC+8)260619-08:49:49 (UTC+8)
430P1 SFT step=4270/4376 epoch=1.952 loss=0.3629 260619-08:45:47 (UTC+8)260619-08:45:49 (UTC+8)
429P1 SFT step=4260/4376 epoch=1.947 loss=0.4062 260619-08:42:25 (UTC+8)260619-08:42:27 (UTC+8)
428P1 SFT step=4250/4376 epoch=1.943 loss=0.3890 260619-08:38:43 (UTC+8)260619-08:38:44 (UTC+8)
427P1 SFT step=4240/4376 epoch=1.938 loss=0.3370 260619-08:34:36 (UTC+8)260619-08:34:37 (UTC+8)
426P1 SFT step=4230/4376 epoch=1.933 loss=0.4220 260619-08:30:42 (UTC+8)260619-08:30:43 (UTC+8)
425P1 SFT step=4220/4376 epoch=1.929 loss=0.3507 260619-08:26:46 (UTC+8)260619-08:26:47 (UTC+8)
424P1 SFT step=4210/4376 epoch=1.924 loss=0.3823 260619-08:22:53 (UTC+8)260619-08:22:54 (UTC+8)
423P1 SFT step=4200/4376 epoch=1.920 loss=0.4170 260619-08:18:19 (UTC+8)260619-08:19:15 (UTC+8)
422P1 SFT step=4190/4376 epoch=1.915 loss=0.4022 260619-08:14:56 (UTC+8)260619-08:15:44 (UTC+8)
421P1 SFT step=4180/4376 epoch=1.911 loss=0.4122 260619-08:11:19 (UTC+8)260619-08:11:58 (UTC+8)
420P1 SFT step=4170/4376 epoch=1.906 loss=0.3583 260619-08:07:34 (UTC+8)260619-08:08:04 (UTC+8)
419P1 SFT step=4160/4376 epoch=1.901 loss=0.3608 260619-08:04:01 (UTC+8)260619-08:04:22 (UTC+8)
418P1 SFT step=4150/4376 epoch=1.897 loss=0.3785 260619-08:00:21 (UTC+8)260619-08:00:33 (UTC+8)
417P1 SFT step=4140/4376 epoch=1.892 loss=0.3864 260619-07:56:38 (UTC+8)260619-07:56:40 (UTC+8)
416P1 SFT step=4130/4376 epoch=1.888 loss=0.3608 260619-07:53:15 (UTC+8)260619-07:53:16 (UTC+8)
415P1 SFT step=4120/4376 epoch=1.883 loss=0.4157 260619-07:49:52 (UTC+8)260619-07:49:53 (UTC+8)
414P1 SFT step=4110/4376 epoch=1.879 loss=0.3708 260619-07:46:05 (UTC+8)260619-07:46:06 (UTC+8)
413P1 SFT step=4100/4376 epoch=1.874 loss=0.3989 260619-07:42:13 (UTC+8)260619-07:42:14 (UTC+8)
412P1 SFT step=4090/4376 epoch=1.869 loss=0.4501 260619-07:38:30 (UTC+8)260619-07:38:31 (UTC+8)
411P1 SFT step=4080/4376 epoch=1.865 loss=0.3772 260619-07:34:37 (UTC+8)260619-07:34:39 (UTC+8)
410P1 SFT step=4070/4376 epoch=1.860 loss=0.3707 260619-07:30:38 (UTC+8)260619-07:30:39 (UTC+8)
409P1 SFT step=4060/4376 epoch=1.856 loss=0.4065 260619-07:26:07 (UTC+8)260619-07:26:58 (UTC+8)
408P1 SFT step=4050/4376 epoch=1.851 loss=0.3892 260619-07:22:17 (UTC+8)260619-07:22:59 (UTC+8)
407P1 SFT step=4040/4376 epoch=1.847 loss=0.4128 260619-07:18:45 (UTC+8)260619-07:19:18 (UTC+8)
406P1 SFT step=4030/4376 epoch=1.842 loss=0.3883 260619-07:15:31 (UTC+8)260619-07:15:55 (UTC+8)
405P1 SFT step=4020/4376 epoch=1.837 loss=0.4000 260619-07:11:32 (UTC+8)260619-07:11:47 (UTC+8)
404P1 SFT step=4010/4376 epoch=1.833 loss=0.3689 260619-07:07:54 (UTC+8)260619-07:07:59 (UTC+8)
403P1 SFT step=4000/4376 epoch=1.828 loss=0.3978 260619-07:04:10 (UTC+8)260619-07:04:11 (UTC+8)
402P1 SFT step=3990/4376 epoch=1.824 loss=0.4003 260619-07:00:16 (UTC+8)260619-07:00:17 (UTC+8)
401P1 SFT step=3980/4376 epoch=1.819 loss=0.3476 260619-06:56:13 (UTC+8)260619-06:56:14 (UTC+8)
400P1 SFT step=3970/4376 epoch=1.815 loss=0.4028 260619-06:52:50 (UTC+8)260619-06:52:51 (UTC+8)
399P1 SFT step=3960/4376 epoch=1.810 loss=0.3678 260619-06:49:14 (UTC+8)260619-06:49:16 (UTC+8)
398P1 SFT step=3950/4376 epoch=1.805 loss=0.3859 260619-06:45:30 (UTC+8)260619-06:45:31 (UTC+8)
397P1 SFT step=3940/4376 epoch=1.801 loss=0.4294 260619-06:41:46 (UTC+8)260619-06:41:48 (UTC+8)
396P1 SFT step=3930/4376 epoch=1.796 loss=0.3688 260619-06:38:10 (UTC+8)260619-06:38:11 (UTC+8)
395P1 SFT step=3920/4376 epoch=1.792 loss=0.3270 260619-06:34:10 (UTC+8)260619-06:34:11 (UTC+8)
394P1 SFT step=3910/4376 epoch=1.787 loss=0.3179 260619-06:30:21 (UTC+8)260619-06:30:23 (UTC+8)
393P1 SFT step=3900/4376 epoch=1.783 loss=0.3716 260619-06:27:50 (UTC+8)260619-06:27:51 (UTC+8)
392P1 SFT step=3890/4376 epoch=1.778 loss=0.3541 260619-06:25:20 (UTC+8)260619-06:25:21 (UTC+8)
391P1 SFT step=3880/4376 epoch=1.773 loss=0.3970 260619-06:22:47 (UTC+8)260619-06:22:48 (UTC+8)
390P1 SFT step=3870/4376 epoch=1.769 loss=0.4016 260619-06:20:14 (UTC+8)260619-06:20:16 (UTC+8)
389P1 SFT step=3860/4376 epoch=1.764 loss=0.3381 260619-06:17:42 (UTC+8)260619-06:17:43 (UTC+8)
388P1 SFT step=3850/4376 epoch=1.760 loss=0.3785 260619-06:15:05 (UTC+8)260619-06:15:06 (UTC+8)
387P1 SFT step=3840/4376 epoch=1.755 loss=0.3932 260619-06:12:34 (UTC+8)260619-06:12:35 (UTC+8)
386P1 SFT step=3830/4376 epoch=1.751 loss=0.4022 260619-06:10:04 (UTC+8)260619-06:10:04 (UTC+8)
385P1 SFT step=3820/4376 epoch=1.746 loss=0.4118 260619-06:07:27 (UTC+8)260619-06:07:28 (UTC+8)
384P1 SFT step=3810/4376 epoch=1.741 loss=0.3924 260619-06:04:56 (UTC+8)260619-06:04:57 (UTC+8)
383P1 SFT step=3800/4376 epoch=1.737 loss=0.3618 260619-06:02:28 (UTC+8)260619-06:02:29 (UTC+8)
382P1 SFT step=3790/4376 epoch=1.732 loss=0.4155 260619-05:59:58 (UTC+8)260619-05:59:59 (UTC+8)
381P1 SFT step=3780/4376 epoch=1.728 loss=0.3839 260619-05:56:32 (UTC+8)260619-05:57:26 (UTC+8)
380P1 SFT step=3770/4376 epoch=1.723 loss=0.3812 260619-05:54:10 (UTC+8)260619-05:54:57 (UTC+8)
379P1 SFT step=3760/4376 epoch=1.719 loss=0.4171 260619-05:51:42 (UTC+8)260619-05:52:23 (UTC+8)
378P1 SFT step=3750/4376 epoch=1.714 loss=0.4079 260619-05:49:16 (UTC+8)260619-05:49:51 (UTC+8)
377P1 SFT step=3740/4376 epoch=1.709 loss=0.4182 260619-05:46:54 (UTC+8)260619-05:47:24 (UTC+8)
376P1 SFT step=3730/4376 epoch=1.705 loss=0.3764 260619-05:44:29 (UTC+8)260619-05:44:53 (UTC+8)
375P1 SFT step=3720/4376 epoch=1.700 loss=0.3921 260619-05:42:09 (UTC+8)260619-05:42:27 (UTC+8)
374P1 SFT step=3710/4376 epoch=1.696 loss=0.4677 260619-05:39:44 (UTC+8)260619-05:39:56 (UTC+8)
373P1 SFT step=3700/4376 epoch=1.691 loss=0.4238 260619-05:37:18 (UTC+8)260619-05:37:24 (UTC+8)
372P1 SFT step=3690/4376 epoch=1.687 loss=0.4251 260619-05:34:51 (UTC+8)260619-05:34:52 (UTC+8)
371P1 SFT step=3680/4376 epoch=1.682 loss=0.3687 260619-05:32:12 (UTC+8)260619-05:32:13 (UTC+8)
370P1 SFT step=3670/4376 epoch=1.677 loss=0.3906 260619-05:29:47 (UTC+8)260619-05:29:48 (UTC+8)
369P1 SFT step=3660/4376 epoch=1.673 loss=0.3831 260619-05:27:13 (UTC+8)260619-05:27:14 (UTC+8)
368P1 SFT step=3650/4376 epoch=1.668 loss=0.3842 260619-05:24:44 (UTC+8)260619-05:24:45 (UTC+8)
367P1 SFT step=3640/4376 epoch=1.664 loss=0.3475 260619-05:22:11 (UTC+8)260619-05:22:12 (UTC+8)
366P1 SFT step=3630/4376 epoch=1.659 loss=0.3791 260619-05:19:43 (UTC+8)260619-05:19:44 (UTC+8)
365P1 SFT step=3620/4376 epoch=1.655 loss=0.4283 260619-05:16:16 (UTC+8)260619-05:17:13 (UTC+8)
364P1 SFT step=3610/4376 epoch=1.650 loss=0.3399 260619-05:13:52 (UTC+8)260619-05:14:42 (UTC+8)
363P1 SFT step=3600/4376 epoch=1.645 loss=0.3775 260619-05:11:26 (UTC+8)260619-05:12:10 (UTC+8)
362P1 SFT step=3590/4376 epoch=1.641 loss=0.4118 260619-05:08:58 (UTC+8)260619-05:09:37 (UTC+8)
361P1 SFT step=3580/4376 epoch=1.636 loss=0.4006 260619-05:06:36 (UTC+8)260619-05:07:08 (UTC+8)
360P1 SFT step=3570/4376 epoch=1.632 loss=0.3810 260619-05:04:06 (UTC+8)260619-05:04:32 (UTC+8)
359P1 SFT step=3560/4376 epoch=1.627 loss=0.4408 260619-05:01:40 (UTC+8)260619-05:02:00 (UTC+8)
358P1 SFT step=3550/4376 epoch=1.623 loss=0.4236 260619-04:59:13 (UTC+8)260619-04:59:27 (UTC+8)
357P1 SFT step=3540/4376 epoch=1.618 loss=0.3764 260619-04:56:44 (UTC+8)260619-04:56:52 (UTC+8)
356P1 SFT step=3530/4376 epoch=1.613 loss=0.4114 260619-04:54:21 (UTC+8)260619-04:54:23 (UTC+8)
355P1 SFT step=3520/4376 epoch=1.609 loss=0.3975 260619-04:51:53 (UTC+8)260619-04:51:54 (UTC+8)
354P1 SFT step=3510/4376 epoch=1.604 loss=0.3673 260619-04:49:22 (UTC+8)260619-04:49:23 (UTC+8)
353P1 SFT step=3500/4376 epoch=1.600 loss=0.4356 260619-04:46:53 (UTC+8)260619-04:46:55 (UTC+8)
352P1 SFT step=3490/4376 epoch=1.595 loss=0.4424 260619-04:44:22 (UTC+8)260619-04:44:24 (UTC+8)
351P1 SFT step=3480/4376 epoch=1.591 loss=0.3512 260619-04:41:54 (UTC+8)260619-04:41:55 (UTC+8)
350P1 SFT step=3470/4376 epoch=1.586 loss=0.4140 260619-04:39:26 (UTC+8)260619-04:39:28 (UTC+8)
349P1 SFT step=3460/4376 epoch=1.581 loss=0.4002 260619-04:37:00 (UTC+8)260619-04:37:01 (UTC+8)
348P1 SFT step=3450/4376 epoch=1.577 loss=0.4119 260619-04:34:25 (UTC+8)260619-04:34:27 (UTC+8)
347P1 SFT step=3440/4376 epoch=1.572 loss=0.3816 260619-04:31:47 (UTC+8)260619-04:31:48 (UTC+8)
346P1 SFT step=3430/4376 epoch=1.568 loss=0.4244 260619-04:29:11 (UTC+8)260619-04:29:13 (UTC+8)
345P1 SFT step=3420/4376 epoch=1.563 loss=0.3808 260619-04:26:42 (UTC+8)260619-04:26:43 (UTC+8)
344P1 SFT step=3410/4376 epoch=1.559 loss=0.4246 260619-04:24:09 (UTC+8)260619-04:24:11 (UTC+8)
343P1 SFT step=3400/4376 epoch=1.554 loss=0.3986 260619-04:21:42 (UTC+8)260619-04:21:43 (UTC+8)
342P1 SFT step=3390/4376 epoch=1.549 loss=0.4139 260619-04:19:04 (UTC+8)260619-04:19:05 (UTC+8)
341P1 SFT step=3380/4376 epoch=1.545 loss=0.4386 260619-04:16:33 (UTC+8)260619-04:16:34 (UTC+8)
340P1 SFT step=3370/4376 epoch=1.540 loss=0.3707 260619-04:13:58 (UTC+8)260619-04:13:59 (UTC+8)
339P1 SFT step=3360/4376 epoch=1.536 loss=0.4461 260619-04:11:22 (UTC+8)260619-04:11:23 (UTC+8)
338P1 SFT step=3350/4376 epoch=1.531 loss=0.4569 260619-04:08:53 (UTC+8)260619-04:08:54 (UTC+8)
337P1 SFT step=3340/4376 epoch=1.527 loss=0.4193 260619-04:06:17 (UTC+8)260619-04:06:19 (UTC+8)
336P1 SFT step=3330/4376 epoch=1.522 loss=0.3667 260619-04:03:42 (UTC+8)260619-04:03:44 (UTC+8)
335P1 SFT step=3320/4376 epoch=1.517 loss=0.4210 260619-04:01:12 (UTC+8)260619-04:01:13 (UTC+8)
334P1 SFT step=3310/4376 epoch=1.513 loss=0.3768 260619-03:58:39 (UTC+8)260619-03:58:39 (UTC+8)
333P1 SFT step=3300/4376 epoch=1.508 loss=0.3625 260619-03:56:00 (UTC+8)260619-03:56:01 (UTC+8)
332P1 SFT step=3290/4376 epoch=1.504 loss=0.4710 260619-03:53:29 (UTC+8)260619-03:53:31 (UTC+8)
331P1 SFT step=3280/4376 epoch=1.499 loss=0.4324 260619-03:50:52 (UTC+8)260619-03:50:53 (UTC+8)
330P1 SFT step=3270/4376 epoch=1.495 loss=0.4549 260619-03:48:21 (UTC+8)260619-03:48:23 (UTC+8)
329P1 SFT step=3260/4376 epoch=1.490 loss=0.3574 260619-03:45:51 (UTC+8)260619-03:45:52 (UTC+8)
328P1 SFT step=3250/4376 epoch=1.485 loss=0.4588 260619-03:43:23 (UTC+8)260619-03:43:24 (UTC+8)
327P1 SFT step=3240/4376 epoch=1.481 loss=0.4337 260619-03:40:53 (UTC+8)260619-03:40:55 (UTC+8)
326P1 SFT step=3230/4376 epoch=1.476 loss=0.4231 260619-03:38:22 (UTC+8)260619-03:38:23 (UTC+8)
325P1 SFT step=3220/4376 epoch=1.472 loss=0.4553 260619-03:36:00 (UTC+8)260619-03:36:01 (UTC+8)
324P1 SFT step=3210/4376 epoch=1.467 loss=0.3966 260619-03:33:25 (UTC+8)260619-03:33:26 (UTC+8)
323P1 SFT step=3200/4376 epoch=1.463 loss=0.4709 260619-03:30:57 (UTC+8)260619-03:30:58 (UTC+8)
322P1 SFT step=3190/4376 epoch=1.458 loss=0.4880 260619-03:28:21 (UTC+8)260619-03:28:22 (UTC+8)
321P1 SFT step=3180/4376 epoch=1.453 loss=0.5143 260619-03:25:53 (UTC+8)260619-03:25:54 (UTC+8)
320P1 SFT step=3170/4376 epoch=1.449 loss=0.4641 260619-03:23:14 (UTC+8)260619-03:23:15 (UTC+8)
319P1 SFT step=3160/4376 epoch=1.444 loss=0.4008 260619-03:20:43 (UTC+8)260619-03:20:44 (UTC+8)
318P1 SFT step=3150/4376 epoch=1.440 loss=0.4378 260619-03:18:11 (UTC+8)260619-03:18:13 (UTC+8)
317P1 SFT step=3140/4376 epoch=1.435 loss=0.4278 260619-03:15:41 (UTC+8)260619-03:15:42 (UTC+8)
316P1 SFT step=3130/4376 epoch=1.431 loss=0.4981 260619-03:13:01 (UTC+8)260619-03:13:03 (UTC+8)
315P1 SFT step=3120/4376 epoch=1.426 loss=0.4594 260619-03:10:23 (UTC+8)260619-03:10:24 (UTC+8)
314P1 SFT step=3110/4376 epoch=1.421 loss=0.4465 260619-03:07:50 (UTC+8)260619-03:07:51 (UTC+8)
313P1 SFT step=3100/4376 epoch=1.417 loss=0.4547 260619-03:05:27 (UTC+8)260619-03:05:29 (UTC+8)
312P1 SFT step=3090/4376 epoch=1.412 loss=0.4807 260619-03:02:53 (UTC+8)260619-03:02:55 (UTC+8)
311P1 SFT step=3080/4376 epoch=1.408 loss=0.4455 260619-03:00:15 (UTC+8)260619-03:00:16 (UTC+8)
310P1 SFT step=3070/4376 epoch=1.403 loss=0.4488 260619-02:57:39 (UTC+8)260619-02:57:41 (UTC+8)
309P1 SFT step=3060/4376 epoch=1.399 loss=0.4898 260619-02:55:09 (UTC+8)260619-02:55:10 (UTC+8)
308P1 SFT step=3050/4376 epoch=1.394 loss=0.4552 260619-02:51:37 (UTC+8)260619-02:52:36 (UTC+8)
307P1 SFT step=3040/4376 epoch=1.389 loss=0.4713 260619-02:49:15 (UTC+8)260619-02:50:08 (UTC+8)
306P1 SFT step=3030/4376 epoch=1.385 loss=0.4641 260619-02:46:51 (UTC+8)260619-02:47:38 (UTC+8)
305P1 SFT step=3020/4376 epoch=1.380 loss=0.4761 260619-02:44:26 (UTC+8)260619-02:45:07 (UTC+8)
304P1 SFT step=3010/4376 epoch=1.376 loss=0.4257 260619-02:41:55 (UTC+8)260619-02:42:30 (UTC+8)
303P1 SFT step=3000/4376 epoch=1.371 loss=0.4312 260619-02:39:36 (UTC+8)260619-02:40:05 (UTC+8)
302P1 SFT step=2990/4376 epoch=1.367 loss=0.4031 260619-02:37:14 (UTC+8)260619-02:37:37 (UTC+8)
301P1 SFT step=2980/4376 epoch=1.362 loss=0.4700 260619-02:34:54 (UTC+8)260619-02:35:11 (UTC+8)
300P1 SFT step=2970/4376 epoch=1.357 loss=0.4253 260619-02:32:30 (UTC+8)260619-02:32:41 (UTC+8)
299P1 SFT step=2960/4376 epoch=1.353 loss=0.4736 260619-02:30:08 (UTC+8)260619-02:30:13 (UTC+8)
298P1 SFT step=2950/4376 epoch=1.348 loss=0.4162 260619-02:27:40 (UTC+8)260619-02:27:41 (UTC+8)
297P1 SFT step=2940/4376 epoch=1.344 loss=0.4390 260619-02:25:04 (UTC+8)260619-02:25:05 (UTC+8)
296P1 SFT step=2930/4376 epoch=1.339 loss=0.4788 260619-02:22:33 (UTC+8)260619-02:22:34 (UTC+8)
295P1 SFT step=2920/4376 epoch=1.335 loss=0.4394 260619-02:19:54 (UTC+8)260619-02:19:55 (UTC+8)
294P1 SFT step=2910/4376 epoch=1.330 loss=0.4523 260619-02:17:20 (UTC+8)260619-02:17:22 (UTC+8)
293P1 SFT step=2900/4376 epoch=1.325 loss=0.4905 260619-02:14:57 (UTC+8)260619-02:14:59 (UTC+8)
292P1 SFT step=2890/4376 epoch=1.321 loss=0.4813 260619-02:12:21 (UTC+8)260619-02:12:22 (UTC+8)
291P1 SFT step=2880/4376 epoch=1.316 loss=0.5156 260619-02:09:53 (UTC+8)260619-02:09:55 (UTC+8)
290P1 SFT step=2870/4376 epoch=1.312 loss=0.4682 260619-02:07:21 (UTC+8)260619-02:07:22 (UTC+8)
289P1 SFT step=2860/4376 epoch=1.307 loss=0.4697 260619-02:04:49 (UTC+8)260619-02:04:50 (UTC+8)
288P1 SFT step=2850/4376 epoch=1.303 loss=0.4565 260619-02:02:14 (UTC+8)260619-02:02:15 (UTC+8)
287P1 SFT step=2840/4376 epoch=1.298 loss=0.4633 260619-01:59:40 (UTC+8)260619-01:59:41 (UTC+8)
286P1 SFT step=2830/4376 epoch=1.293 loss=0.4870 260619-01:57:13 (UTC+8)260619-01:57:14 (UTC+8)
285P1 SFT step=2820/4376 epoch=1.289 loss=0.4389 260619-01:54:39 (UTC+8)260619-01:54:41 (UTC+8)
284P1 SFT step=2810/4376 epoch=1.284 loss=0.4799 260619-01:52:13 (UTC+8)260619-01:52:14 (UTC+8)
283P1 SFT step=2800/4376 epoch=1.280 loss=0.5150 260619-01:49:39 (UTC+8)260619-01:49:40 (UTC+8)
282P1 SFT step=2790/4376 epoch=1.275 loss=0.5006 260619-01:47:10 (UTC+8)260619-01:47:11 (UTC+8)
281P1 SFT step=2780/4376 epoch=1.271 loss=0.4655 260619-01:44:40 (UTC+8)260619-01:44:41 (UTC+8)
280P1 SFT step=2770/4376 epoch=1.266 loss=0.4440 260619-01:42:09 (UTC+8)260619-01:42:11 (UTC+8)
279P1 SFT step=2760/4376 epoch=1.261 loss=0.4205 260619-01:39:38 (UTC+8)260619-01:39:39 (UTC+8)
278P1 SFT step=2750/4376 epoch=1.257 loss=0.5097 260619-01:37:04 (UTC+8)260619-01:37:06 (UTC+8)
277P1 SFT step=2740/4376 epoch=1.252 loss=0.4713 260619-01:34:32 (UTC+8)260619-01:34:34 (UTC+8)
276P1 SFT step=2730/4376 epoch=1.248 loss=0.4788 260619-01:32:00 (UTC+8)260619-01:32:01 (UTC+8)
275P1 SFT step=2720/4376 epoch=1.243 loss=0.5292 260619-01:29:36 (UTC+8)260619-01:29:37 (UTC+8)
274P1 SFT step=2710/4376 epoch=1.239 loss=0.5156 260619-01:27:02 (UTC+8)260619-01:27:03 (UTC+8)
273P1 SFT step=2700/4376 epoch=1.234 loss=0.5187 260619-01:24:27 (UTC+8)260619-01:24:29 (UTC+8)
272P1 SFT step=2690/4376 epoch=1.229 loss=0.5323 260619-01:21:56 (UTC+8)260619-01:21:57 (UTC+8)
271P1 SFT step=2680/4376 epoch=1.225 loss=0.4778 260619-01:19:22 (UTC+8)260619-01:19:24 (UTC+8)
270P1 SFT step=2670/4376 epoch=1.220 loss=0.5223 260619-01:16:53 (UTC+8)260619-01:16:54 (UTC+8)
269P1 SFT step=2660/4376 epoch=1.216 loss=0.5240 260619-01:14:16 (UTC+8)260619-01:14:17 (UTC+8)
268P1 SFT step=2650/4376 epoch=1.211 loss=0.4656 260619-01:11:53 (UTC+8)260619-01:11:54 (UTC+8)
267P1 SFT step=2640/4376 epoch=1.207 loss=0.4659 260619-01:08:40 (UTC+8)260619-01:08:41 (UTC+8)
266P1 SFT step=2630/4376 epoch=1.202 loss=0.5286 260619-01:03:07 (UTC+8)260619-01:03:09 (UTC+8)
265P1 SFT step=2620/4376 epoch=1.197 loss=0.5111 260619-00:57:32 (UTC+8)260619-00:57:33 (UTC+8)
264P1 SFT step=2610/4376 epoch=1.193 loss=0.5314 260619-00:51:47 (UTC+8)260619-00:51:49 (UTC+8)
263P1 SFT step=2600/4376 epoch=1.188 loss=0.4227 260619-00:46:08 (UTC+8)260619-00:46:09 (UTC+8)
262P1 SFT step=2590/4376 epoch=1.184 loss=0.5041 260619-00:39:49 (UTC+8)260619-00:40:36 (UTC+8)
261P1 SFT step=2580/4376 epoch=1.179 loss=0.5858 260619-00:34:34 (UTC+8)260619-00:35:07 (UTC+8)
260P1 SFT step=2570/4376 epoch=1.175 loss=0.4903 260619-00:29:09 (UTC+8)260619-00:29:29 (UTC+8)
259P1 SFT step=2560/4376 epoch=1.170 loss=0.4943 260619-00:23:50 (UTC+8)260619-00:23:57 (UTC+8)
258P1 SFT step=2550/4376 epoch=1.165 loss=0.4954 260619-00:18:23 (UTC+8)260619-00:18:24 (UTC+8)
257P1 SFT step=2540/4376 epoch=1.161 loss=0.5531 260619-00:12:40 (UTC+8)260619-00:12:42 (UTC+8)
256P1 SFT step=2530/4376 epoch=1.156 loss=0.5168 260619-00:07:24 (UTC+8)260619-00:07:25 (UTC+8)
255P1 SFT step=2520/4376 epoch=1.152 loss=0.5274 260619-00:01:54 (UTC+8)260619-00:01:55 (UTC+8)
254P1 SFT step=2510/4376 epoch=1.147 loss=0.5301 260618-23:56:31 (UTC+8)260618-23:56:32 (UTC+8)
253P1 SFT step=2500/4376 epoch=1.143 loss=0.5751 260618-23:50:50 (UTC+8)260618-23:50:52 (UTC+8)
252P1 SFT step=2490/4376 epoch=1.138 loss=0.4779 260618-23:45:11 (UTC+8)260618-23:45:13 (UTC+8)
251P1 SFT step=2480/4376 epoch=1.133 loss=0.5315 260618-23:39:40 (UTC+8)260618-23:39:41 (UTC+8)
250P1 SFT step=2470/4376 epoch=1.129 loss=0.5283 260618-23:34:36 (UTC+8)260618-23:34:37 (UTC+8)
249P1 SFT step=2460/4376 epoch=1.124 loss=0.4742 260618-23:28:53 (UTC+8)260618-23:28:54 (UTC+8)
248P1 SFT step=2450/4376 epoch=1.120 loss=0.5404 260618-23:23:11 (UTC+8)260618-23:23:12 (UTC+8)
247P1 SFT step=2440/4376 epoch=1.115 loss=0.5115 260618-23:17:45 (UTC+8)260618-23:17:46 (UTC+8)
246P1 SFT step=2430/4376 epoch=1.111 loss=0.5246 260618-23:12:06 (UTC+8)260618-23:12:07 (UTC+8)
245P1 SFT step=2420/4376 epoch=1.106 loss=0.5546 260618-23:06:24 (UTC+8)260618-23:06:26 (UTC+8)
244P1 SFT step=2410/4376 epoch=1.101 loss=0.5283 260618-23:00:50 (UTC+8)260618-23:00:51 (UTC+8)
243P1 SFT step=2400/4376 epoch=1.097 loss=0.5304 260618-22:55:15 (UTC+8)260618-22:55:17 (UTC+8)
242P1 SFT step=2390/4376 epoch=1.092 loss=0.5728 260618-22:49:34 (UTC+8)260618-22:49:36 (UTC+8)
241P1 SFT step=2380/4376 epoch=1.088 loss=0.5468 260618-22:44:07 (UTC+8)260618-22:44:09 (UTC+8)
240P1 SFT step=2370/4376 epoch=1.083 loss=0.5206 260618-22:38:28 (UTC+8)260618-22:38:29 (UTC+8)
239P1 SFT step=2360/4376 epoch=1.079 loss=0.5180 260618-22:32:55 (UTC+8)260618-22:32:56 (UTC+8)
238P1 SFT step=2350/4376 epoch=1.074 loss=0.5389 260618-22:27:08 (UTC+8)260618-22:27:09 (UTC+8)
237P1 SFT step=2340/4376 epoch=1.069 loss=0.5649 260618-22:21:35 (UTC+8)260618-22:21:36 (UTC+8)
236P1 SFT step=2330/4376 epoch=1.065 loss=0.5220 260618-22:15:58 (UTC+8)260618-22:15:59 (UTC+8)
235P1 SFT step=2320/4376 epoch=1.060 loss=0.5382 260618-22:10:14 (UTC+8)260618-22:10:15 (UTC+8)
234P1 SFT step=2310/4376 epoch=1.056 loss=0.5744 260618-22:06:15 (UTC+8)260618-22:06:16 (UTC+8)
233P1 SFT step=2300/4376 epoch=1.051 loss=0.5504 260618-22:01:59 (UTC+8)260618-22:02:00 (UTC+8)
232P1 SFT step=2290/4376 epoch=1.047 loss=0.5789 260618-21:55:35 (UTC+8)260618-21:56:25 (UTC+8)
231P1 SFT step=2280/4376 epoch=1.042 loss=0.5853 260618-21:50:22 (UTC+8)260618-21:50:58 (UTC+8)
230P1 SFT step=2270/4376 epoch=1.037 loss=0.5452 260618-21:44:51 (UTC+8)260618-21:45:13 (UTC+8)
229P1 SFT step=2260/4376 epoch=1.033 loss=0.5200 260618-21:39:30 (UTC+8)260618-21:39:39 (UTC+8)
228P1 SFT step=2250/4376 epoch=1.028 loss=0.5384 260618-21:34:10 (UTC+8)260618-21:34:12 (UTC+8)
227P1 SFT step=2240/4376 epoch=1.024 loss=0.5492 260618-21:28:38 (UTC+8)260618-21:28:39 (UTC+8)
226P1 SFT step=2230/4376 epoch=1.019 loss=0.5662 260618-21:23:15 (UTC+8)260618-21:23:16 (UTC+8)
225P1 SFT step=2220/4376 epoch=1.015 loss=0.5234 260618-21:17:50 (UTC+8)260618-21:17:50 (UTC+8)
224P1 SFT step=2210/4376 epoch=1.010 loss=0.5268 260618-21:12:22 (UTC+8)260618-21:12:23 (UTC+8)
223P1 SFT step=2200/4376 epoch=1.005 loss=0.5724 260618-21:05:58 (UTC+8)260618-21:06:54 (UTC+8)
222P1 SFT step=2190/4376 epoch=1.001 loss=0.5601 260618-21:01:21 (UTC+8)260618-21:02:06 (UTC+8)
221P1 SFT checkpoint:step=2188 epoch=1.000 260618-21:00:20 (UTC+8)260618-21:01:02 (UTC+8)
220P1 SFT step=2180/4376 epoch=0.997 loss=0.7041 260618-20:56:19 (UTC+8)260618-20:56:51 (UTC+8)
219P1 SFT step=2170/4376 epoch=0.992 loss=0.6776 260618-20:50:57 (UTC+8)260618-20:51:16 (UTC+8)
218P1 SFT step=2160/4376 epoch=0.987 loss=0.5574 260618-20:45:31 (UTC+8)260618-20:45:36 (UTC+8)
217P1 SFT step=2150/4376 epoch=0.983 loss=0.6825 260618-20:40:14 (UTC+8)260618-20:40:14 (UTC+8)
216P1 SFT step=2140/4376 epoch=0.978 loss=0.5845 260618-20:34:54 (UTC+8)260618-20:34:55 (UTC+8)
215P1 SFT step=2130/4376 epoch=0.974 loss=0.6017 260618-20:29:17 (UTC+8)260618-20:29:18 (UTC+8)
214P1 SFT step=2110/4376 epoch=0.965 loss=0.6877 260618-20:18:04 (UTC+8)260618-20:18:06 (UTC+8)
213P1 SFT step=2100/4376 epoch=0.960 loss=0.6727 260618-20:12:26 (UTC+8)260618-20:12:28 (UTC+8)
212P1 SFT step=2090/4376 epoch=0.955 loss=0.7472 260618-20:07:06 (UTC+8)260618-20:07:09 (UTC+8)
211P1 SFT step=2080/4376 epoch=0.951 loss=0.6076 260618-20:03:11 (UTC+8)260618-20:03:12 (UTC+8)
210P1 SFT step=2070/4376 epoch=0.946 loss=0.6948 260618-19:58:54 (UTC+8)260618-19:58:56 (UTC+8)
209P1 SFT step=2060/4376 epoch=0.942 loss=0.7591 260618-19:53:36 (UTC+8)260618-19:53:36 (UTC+8)
208P1 SFT step=2050/4376 epoch=0.937 loss=0.6347 260618-19:48:14 (UTC+8)260618-19:48:16 (UTC+8)
207P1 SFT step=2040/4376 epoch=0.933 loss=0.6964 260618-19:42:36 (UTC+8)260618-19:42:37 (UTC+8)
206P1 SFT step=2030/4376 epoch=0.928 loss=0.7334 260618-19:36:54 (UTC+8)260618-19:36:55 (UTC+8)
205P1 SFT step=2020/4376 epoch=0.923 loss=0.7064 260618-19:31:19 (UTC+8)260618-19:31:21 (UTC+8)
204P1 SFT step=2010/4376 epoch=0.919 loss=0.7031 260618-19:25:48 (UTC+8)260618-19:25:49 (UTC+8)
203P1 SFT step=2000/4376 epoch=0.914 loss=0.6462 260618-19:20:23 (UTC+8)260618-19:20:24 (UTC+8)
202P1 SFT step=1990/4376 epoch=0.910 loss=0.6502 260618-19:15:19 (UTC+8)260618-19:15:20 (UTC+8)
201P1 SFT step=1980/4376 epoch=0.905 loss=0.7318 260618-19:10:13 (UTC+8)260618-19:10:14 (UTC+8)
200P1 SFT step=1970/4376 epoch=0.901 loss=0.7358 260618-19:04:44 (UTC+8)260618-19:04:45 (UTC+8)
199P1 SFT step=1960/4376 epoch=0.896 loss=0.6425 260618-18:59:03 (UTC+8)260618-18:59:05 (UTC+8)
198P1 SFT step=1950/4376 epoch=0.891 loss=0.6542 260618-18:53:25 (UTC+8)260618-18:53:26 (UTC+8)
197P1 SFT step=1940/4376 epoch=0.887 loss=0.6901 260618-18:47:47 (UTC+8)260618-18:47:48 (UTC+8)
196P1 SFT step=1930/4376 epoch=0.882 loss=0.7398 260618-18:42:14 (UTC+8)260618-18:42:15 (UTC+8)
195P1 SFT step=1920/4376 epoch=0.878 loss=0.7100 260618-18:36:41 (UTC+8)260618-18:36:42 (UTC+8)
194P1 SFT step=1910/4376 epoch=0.873 loss=0.6836 260618-18:29:18 (UTC+8)260618-18:29:20 (UTC+8)
193P1 SFT step=1900/4376 epoch=0.869 loss=0.6428 260618-18:22:48 (UTC+8)260618-18:22:50 (UTC+8)
192P1 SFT step=1890/4376 epoch=0.864 loss=0.6618 260618-18:17:13 (UTC+8)260618-18:17:14 (UTC+8)
191P1 SFT step=1880/4376 epoch=0.859 loss=0.7040 260618-18:11:44 (UTC+8)260618-18:11:45 (UTC+8)
190P1 SFT step=1870/4376 epoch=0.855 loss=0.7483 260618-18:07:03 (UTC+8)260618-18:07:04 (UTC+8)
189P1 SFT step=1860/4376 epoch=0.850 loss=0.7200 260618-18:04:16 (UTC+8)260618-18:04:17 (UTC+8)
188P1 SFT step=1850/4376 epoch=0.846 loss=0.6878 260618-18:01:38 (UTC+8)260618-18:01:41 (UTC+8)
187P1 SFT step=1840/4376 epoch=0.841 loss=0.7227 260618-17:59:08 (UTC+8)260618-17:59:09 (UTC+8)
186P1 SFT step=1830/4376 epoch=0.837 loss=0.7237 260618-17:56:36 (UTC+8)260618-17:56:36 (UTC+8)
185P1 SFT step=1820/4376 epoch=0.832 loss=0.7429 260618-17:54:08 (UTC+8)260618-17:54:09 (UTC+8)
184P1 SFT step=1810/4376 epoch=0.827 loss=0.7523 260618-17:51:42 (UTC+8)260618-17:51:43 (UTC+8)
183P1 SFT step=1800/4376 epoch=0.823 loss=0.7613 260618-17:49:04 (UTC+8)260618-17:49:06 (UTC+8)
182P1 SFT step=1790/4376 epoch=0.818 loss=0.6974 260618-17:46:31 (UTC+8)260618-17:46:32 (UTC+8)
181P1 SFT step=1780/4376 epoch=0.814 loss=0.6923 260618-17:43:57 (UTC+8)260618-17:43:58 (UTC+8)
180P1 SFT step=1770/4376 epoch=0.809 loss=0.6995 260618-17:41:26 (UTC+8)260618-17:41:27 (UTC+8)
179P1 SFT step=1760/4376 epoch=0.805 loss=0.7314 260618-17:38:50 (UTC+8)260618-17:38:51 (UTC+8)
178P1 SFT step=1750/4376 epoch=0.800 loss=0.7735 260618-17:36:12 (UTC+8)260618-17:36:13 (UTC+8)
177P1 SFT step=1740/4376 epoch=0.795 loss=0.6852 260618-17:33:37 (UTC+8)260618-17:33:39 (UTC+8)
176P1 SFT step=1730/4376 epoch=0.791 loss=0.6998 260618-17:31:13 (UTC+8)260618-17:31:15 (UTC+8)
175P1 SFT step=1720/4376 epoch=0.786 loss=0.7193 260618-17:28:39 (UTC+8)260618-17:28:40 (UTC+8)
174P1 SFT step=1710/4376 epoch=0.782 loss=0.7168 260618-17:26:16 (UTC+8)260618-17:26:17 (UTC+8)
173P1 SFT step=1700/4376 epoch=0.777 loss=0.7698 260618-17:23:49 (UTC+8)260618-17:23:50 (UTC+8)
172P1 SFT step=1690/4376 epoch=0.773 loss=0.7924 260618-17:21:18 (UTC+8)260618-17:21:20 (UTC+8)
171P1 SFT step=1680/4376 epoch=0.768 loss=0.7715 260618-17:18:42 (UTC+8)260618-17:18:44 (UTC+8)
170P1 SFT step=1670/4376 epoch=0.763 loss=0.7365 260618-17:16:11 (UTC+8)260618-17:16:12 (UTC+8)
169P1 SFT step=1660/4376 epoch=0.759 loss=0.8590 260618-17:13:37 (UTC+8)260618-17:13:39 (UTC+8)
168P1 SFT step=1650/4376 epoch=0.754 loss=0.7227 260618-17:11:05 (UTC+8)260618-17:11:06 (UTC+8)
167P1 SFT step=1640/4376 epoch=0.750 loss=0.7326 260618-17:08:31 (UTC+8)260618-17:08:33 (UTC+8)
166P1 SFT step=1630/4376 epoch=0.745 loss=0.8068 260618-17:05:28 (UTC+8)260618-17:05:30 (UTC+8)
165P1 SFT step=1620/4376 epoch=0.741 loss=0.8248 260618-17:01:27 (UTC+8)260618-17:01:28 (UTC+8)
164P1 SFT step=1610/4376 epoch=0.736 loss=0.7695 260618-16:57:01 (UTC+8)260618-16:57:03 (UTC+8)
163P1 SFT step=1600/4376 epoch=0.731 loss=0.8095 260618-16:54:18 (UTC+8)260618-16:54:20 (UTC+8)
162P1 SFT step=1590/4376 epoch=0.727 loss=0.7477 260618-16:50:16 (UTC+8)260618-16:50:18 (UTC+8)
161P1 SFT step=1580/4376 epoch=0.722 loss=0.7188 260618-16:47:46 (UTC+8)260618-16:47:47 (UTC+8)
160P1 SFT step=1570/4376 epoch=0.718 loss=0.7252 260618-16:45:13 (UTC+8)260618-16:45:14 (UTC+8)
159P1 SFT step=1560/4376 epoch=0.713 loss=0.7157 260618-16:42:41 (UTC+8)260618-16:42:42 (UTC+8)
158P1 SFT step=1550/4376 epoch=0.709 loss=0.7901 260618-16:40:04 (UTC+8)260618-16:40:05 (UTC+8)
157P1 SFT step=1540/4376 epoch=0.704 loss=0.6910 260618-16:37:29 (UTC+8)260618-16:37:30 (UTC+8)
156P1 SFT step=1530/4376 epoch=0.699 loss=0.8211 260618-16:34:58 (UTC+8)260618-16:35:00 (UTC+8)
155P1 SFT step=1520/4376 epoch=0.695 loss=0.8293 260618-16:32:23 (UTC+8)260618-16:32:24 (UTC+8)
154P1 SFT step=1510/4376 epoch=0.690 loss=0.7760 260618-16:29:55 (UTC+8)260618-16:29:56 (UTC+8)
153P1 SFT step=1500/4376 epoch=0.686 loss=0.8384 260618-16:27:16 (UTC+8)260618-16:27:17 (UTC+8)
152P1 SFT step=1490/4376 epoch=0.681 loss=0.7480 260618-16:24:42 (UTC+8)260618-16:24:44 (UTC+8)
151P1 SFT step=1480/4376 epoch=0.677 loss=0.8261 260618-16:22:18 (UTC+8)260618-16:22:19 (UTC+8)
150P1 SFT step=1470/4376 epoch=0.672 loss=0.8371 260618-16:19:44 (UTC+8)260618-16:19:45 (UTC+8)
149P1 SFT step=1460/4376 epoch=0.667 loss=0.7925 260618-16:17:06 (UTC+8)260618-16:17:07 (UTC+8)
148P1 SFT step=1450/4376 epoch=0.663 loss=0.8143 260618-16:14:35 (UTC+8)260618-16:14:35 (UTC+8)
147P1 SFT step=1440/4376 epoch=0.658 loss=0.7294 260618-16:11:59 (UTC+8)260618-16:12:01 (UTC+8)
146P1 SFT step=1430/4376 epoch=0.654 loss=0.8762 260618-16:09:34 (UTC+8)260618-16:09:35 (UTC+8)
145P1 SFT step=1420/4376 epoch=0.649 loss=0.8190 260618-16:06:55 (UTC+8)260618-16:06:56 (UTC+8)
144P1 SFT step=1410/4376 epoch=0.645 loss=0.7427 260618-16:03:36 (UTC+8)260618-16:03:38 (UTC+8)
143P1 SFT step=1400/4376 epoch=0.640 loss=0.8128 260618-15:58:15 (UTC+8)260618-15:58:17 (UTC+8)
142P1 SFT step=1390/4376 epoch=0.635 loss=0.7952 260618-15:53:00 (UTC+8)260618-15:53:01 (UTC+8)
141P1 SFT step=1380/4376 epoch=0.631 loss=0.8691 260618-15:49:13 (UTC+8)260618-15:49:15 (UTC+8)
140P1 SFT step=1370/4376 epoch=0.626 loss=0.8595 260618-15:46:40 (UTC+8)260618-15:46:41 (UTC+8)
139P1 SFT step=1360/4376 epoch=0.622 loss=0.8647 260618-15:43:12 (UTC+8)260618-15:43:14 (UTC+8)
138P1 SFT step=1350/4376 epoch=0.617 loss=0.8127 260618-15:40:38 (UTC+8)260618-15:40:40 (UTC+8)
137P1 SFT step=1340/4376 epoch=0.613 loss=0.8808 260618-15:38:05 (UTC+8)260618-15:38:06 (UTC+8)
136P1 SFT step=1330/4376 epoch=0.608 loss=0.9229 260618-15:35:32 (UTC+8)260618-15:35:33 (UTC+8)
135P1 SFT step=1320/4376 epoch=0.603 loss=0.8714 260618-15:32:59 (UTC+8)260618-15:33:00 (UTC+8)
134P1 SFT step=1310/4376 epoch=0.599 loss=0.8291 260618-15:30:32 (UTC+8)260618-15:30:33 (UTC+8)
133P1 SFT step=1300/4376 epoch=0.594 loss=0.7960 260618-15:27:51 (UTC+8)260618-15:27:53 (UTC+8)
132P1 SFT step=1290/4376 epoch=0.590 loss=0.8990 260618-15:25:24 (UTC+8)260618-15:25:26 (UTC+8)
131P1 SFT step=1280/4376 epoch=0.585 loss=0.8502 260618-15:22:57 (UTC+8)260618-15:22:58 (UTC+8)
130P1 SFT step=1270/4376 epoch=0.581 loss=0.8789 260618-15:20:22 (UTC+8)260618-15:20:23 (UTC+8)
129P1 SFT step=1260/4376 epoch=0.576 loss=0.9192 260618-15:18:02 (UTC+8)260618-15:18:02 (UTC+8)
128P1 SFT step=1250/4376 epoch=0.571 loss=0.8835 260618-15:15:24 (UTC+8)260618-15:15:27 (UTC+8)
127P1 SFT step=1240/4376 epoch=0.567 loss=0.8361 260618-15:12:51 (UTC+8)260618-15:12:51 (UTC+8)
126P1 SFT step=1230/4376 epoch=0.562 loss=0.9199 260618-15:10:13 (UTC+8)260618-15:10:15 (UTC+8)
125P1 SFT step=1220/4376 epoch=0.558 loss=0.8874 260618-15:07:46 (UTC+8)260618-15:07:49 (UTC+8)
124P1 SFT step=1210/4376 epoch=0.553 loss=0.9139 260618-15:05:12 (UTC+8)260618-15:05:13 (UTC+8)
123P1 SFT step=1200/4376 epoch=0.549 loss=0.9330 260618-15:02:36 (UTC+8)260618-15:02:38 (UTC+8)
122P1 SFT step=1190/4376 epoch=0.544 loss=0.8931 260618-15:00:00 (UTC+8)260618-15:00:02 (UTC+8)
121P1 SFT step=1180/4376 epoch=0.539 loss=0.9061 260618-14:57:19 (UTC+8)260618-14:57:22 (UTC+8)
120P1 SFT step=1170/4376 epoch=0.535 loss=0.8450 260618-14:54:43 (UTC+8)260618-14:54:44 (UTC+8)
119P1 SFT step=1160/4376 epoch=0.530 loss=0.9492 260618-14:52:18 (UTC+8)260618-14:52:19 (UTC+8)
118P1 SFT step=1150/4376 epoch=0.526 loss=0.9411 260618-14:49:49 (UTC+8)260618-14:49:50 (UTC+8)
117P1 SFT step=1140/4376 epoch=0.521 loss=0.8717 260618-14:47:17 (UTC+8)260618-14:47:17 (UTC+8)
116P1 SFT step=1130/4376 epoch=0.517 loss=0.9038 260618-14:44:47 (UTC+8)260618-14:44:48 (UTC+8)
115P1 SFT step=1120/4376 epoch=0.512 loss=0.9379 260618-14:42:14 (UTC+8)260618-14:42:15 (UTC+8)
114P1 SFT step=1110/4376 epoch=0.507 loss=0.8985 260618-14:39:39 (UTC+8)260618-14:39:40 (UTC+8)
113P1 SFT step=1100/4376 epoch=0.503 loss=0.9093 260618-14:37:11 (UTC+8)260618-14:37:12 (UTC+8)
112P1 SFT step=1090/4376 epoch=0.498 loss=0.9172 260618-14:34:39 (UTC+8)260618-14:34:40 (UTC+8)
111P1 SFT step=1080/4376 epoch=0.494 loss=0.9022 260618-14:32:08 (UTC+8)260618-14:32:10 (UTC+8)
110P1 SFT step=1070/4376 epoch=0.489 loss=0.9764 260618-14:29:39 (UTC+8)260618-14:29:40 (UTC+8)
109P1 SFT step=1060/4376 epoch=0.485 loss=0.9387 260618-14:27:03 (UTC+8)260618-14:27:04 (UTC+8)
108P1 SFT step=1050/4376 epoch=0.480 loss=0.9386 260618-14:24:35 (UTC+8)260618-14:24:36 (UTC+8)
107P1 SFT step=1040/4376 epoch=0.475 loss=0.8469 260618-14:22:01 (UTC+8)260618-14:22:02 (UTC+8)
106P1 SFT step=1030/4376 epoch=0.471 loss=0.8816 260618-14:19:31 (UTC+8)260618-14:19:32 (UTC+8)
105P1 SFT step=1020/4376 epoch=0.466 loss=0.9784 260618-14:16:56 (UTC+8)260618-14:16:57 (UTC+8)
104P1 SFT step=1010/4376 epoch=0.462 loss=0.9801 260618-14:14:16 (UTC+8)260618-14:14:17 (UTC+8)
103P1 SFT step=1000/4376 epoch=0.457 loss=1.0136 260618-14:11:45 (UTC+8)260618-14:11:46 (UTC+8)
102P1 SFT step=990/4376 epoch=0.453 loss=0.9848 260618-14:09:20 (UTC+8)260618-14:09:21 (UTC+8)
101P1 SFT step=980/4376 epoch=0.448 loss=0.9379 260618-14:06:42 (UTC+8)260618-14:06:43 (UTC+8)
100P1 SFT step=970/4376 epoch=0.443 loss=0.9453 260618-14:04:14 (UTC+8)260618-14:04:15 (UTC+8)
99P1 SFT step=960/4376 epoch=0.439 loss=0.9842 260618-14:01:41 (UTC+8)260618-14:01:43 (UTC+8)
98P1 SFT step=950/4376 epoch=0.434 loss=1.0467 260618-13:59:07 (UTC+8)260618-13:59:07 (UTC+8)
97P1 SFT step=940/4376 epoch=0.430 loss=1.0400 260618-13:56:39 (UTC+8)260618-13:56:41 (UTC+8)
96P1 SFT step=930/4376 epoch=0.425 loss=0.9651 260618-13:54:11 (UTC+8)260618-13:54:12 (UTC+8)
95P1 SFT step=920/4376 epoch=0.421 loss=0.9559 260618-13:51:44 (UTC+8)260618-13:51:45 (UTC+8)
94P1 SFT step=910/4376 epoch=0.416 loss=1.0521 260618-13:49:15 (UTC+8)260618-13:49:17 (UTC+8)
93P1 SFT step=900/4376 epoch=0.411 loss=1.0525 260618-13:46:45 (UTC+8)260618-13:46:46 (UTC+8)
92P1 SFT step=890/4376 epoch=0.407 loss=1.0112 260618-13:44:21 (UTC+8)260618-13:44:22 (UTC+8)
91P1 SFT step=880/4376 epoch=0.402 loss=1.0467 260618-13:41:45 (UTC+8)260618-13:41:47 (UTC+8)
90P1 SFT step=870/4376 epoch=0.398 loss=0.9790 260618-13:38:24 (UTC+8)260618-13:39:23 (UTC+8)
89P1 SFT step=860/4376 epoch=0.393 loss=1.0339 260618-13:36:03 (UTC+8)260618-13:36:55 (UTC+8)
88P1 SFT step=850/4376 epoch=0.389 loss=1.0277 260618-13:33:42 (UTC+8)260618-13:34:29 (UTC+8)
87P1 SFT step=840/4376 epoch=0.384 loss=1.0275 260618-13:31:13 (UTC+8)260618-13:31:54 (UTC+8)
86P1 SFT step=830/4376 epoch=0.379 loss=1.0842 260618-13:28:46 (UTC+8)260618-13:29:20 (UTC+8)
85P1 SFT step=820/4376 epoch=0.375 loss=1.0471 260618-13:26:19 (UTC+8)260618-13:26:47 (UTC+8)
84P1 SFT step=810/4376 epoch=0.370 loss=1.1199 260618-13:23:49 (UTC+8)260618-13:24:11 (UTC+8)
83P1 SFT step=800/4376 epoch=0.366 loss=1.1394 260618-13:21:17 (UTC+8)260618-13:21:33 (UTC+8)
82P1 SFT step=790/4376 epoch=0.361 loss=1.1187 260618-13:18:51 (UTC+8)260618-13:19:01 (UTC+8)
81P1 SFT step=780/4376 epoch=0.357 loss=1.0682 260618-13:16:21 (UTC+8)260618-13:16:25 (UTC+8)
80P1 SFT step=770/4376 epoch=0.352 loss=1.1480 260618-13:13:48 (UTC+8)260618-13:13:50 (UTC+8)
79P1 SFT step=760/4376 epoch=0.347 loss=1.1327 260618-13:11:17 (UTC+8)260618-13:11:18 (UTC+8)
78P1 SFT step=750/4376 epoch=0.343 loss=1.1060 260618-13:08:45 (UTC+8)260618-13:08:47 (UTC+8)
77P1 SFT step=740/4376 epoch=0.338 loss=1.0403 260618-13:06:06 (UTC+8)260618-13:06:07 (UTC+8)
76P1 SFT step=730/4376 epoch=0.334 loss=1.1041 260618-13:03:40 (UTC+8)260618-13:03:42 (UTC+8)
75P1 SFT step=720/4376 epoch=0.329 loss=1.0346 260618-13:01:11 (UTC+8)260618-13:01:13 (UTC+8)
74P1 SFT step=710/4376 epoch=0.325 loss=1.0877 260618-12:58:28 (UTC+8)260618-12:58:30 (UTC+8)
73P1 SFT step=700/4376 epoch=0.320 loss=1.1796 260618-12:55:43 (UTC+8)260618-12:55:47 (UTC+8)
72P1 SFT step=690/4376 epoch=0.315 loss=1.0792 260618-12:53:10 (UTC+8)260618-12:53:11 (UTC+8)
71P1 SFT step=680/4376 epoch=0.311 loss=1.1210 260618-12:50:38 (UTC+8)260618-12:50:39 (UTC+8)
70P1 SFT step=670/4376 epoch=0.306 loss=1.1825 260618-12:48:06 (UTC+8)260618-12:48:07 (UTC+8)
69P1 SFT step=660/4376 epoch=0.302 loss=1.1633 260618-12:45:38 (UTC+8)260618-12:45:39 (UTC+8)
68P1 SFT step=650/4376 epoch=0.297 loss=1.1458 260618-12:43:01 (UTC+8)260618-12:43:02 (UTC+8)
67P1 SFT step=640/4376 epoch=0.293 loss=1.2041 260618-12:40:26 (UTC+8)260618-12:40:27 (UTC+8)
66P1 SFT step=630/4376 epoch=0.288 loss=1.2108 260618-12:37:50 (UTC+8)260618-12:37:51 (UTC+8)
65P1 SFT step=620/4376 epoch=0.283 loss=1.2413 260618-12:35:20 (UTC+8)260618-12:35:21 (UTC+8)
64P1 SFT step=610/4376 epoch=0.279 loss=1.2598 260618-12:32:46 (UTC+8)260618-12:32:48 (UTC+8)
63P1 SFT step=600/4376 epoch=0.274 loss=1.2474 260618-12:30:08 (UTC+8)260618-12:30:09 (UTC+8)
62P1 SFT step=590/4376 epoch=0.270 loss=1.1941 260618-12:27:35 (UTC+8)260618-12:27:37 (UTC+8)
61P1 SFT step=580/4376 epoch=0.265 loss=1.2546 260618-12:25:01 (UTC+8)260618-12:25:03 (UTC+8)
60P1 SFT step=570/4376 epoch=0.261 loss=1.2313 260618-12:22:32 (UTC+8)260618-12:22:34 (UTC+8)
59P1 SFT step=560/4376 epoch=0.256 loss=1.2903 260618-12:20:05 (UTC+8)260618-12:20:06 (UTC+8)
58P1 SFT step=550/4376 epoch=0.251 loss=1.2964 260618-12:17:28 (UTC+8)260618-12:17:28 (UTC+8)
57P1 SFT step=540/4376 epoch=0.247 loss=1.1796 260618-12:14:58 (UTC+8)260618-12:14:58 (UTC+8)
56P1 SFT step=530/4376 epoch=0.242 loss=1.2006 260618-12:12:20 (UTC+8)260618-12:12:21 (UTC+8)
55P1 SFT step=520/4376 epoch=0.238 loss=1.2751 260618-12:09:47 (UTC+8)260618-12:09:47 (UTC+8)
54P1 SFT step=510/4376 epoch=0.233 loss=1.2320 260618-12:07:08 (UTC+8)260618-12:07:09 (UTC+8)
53P1 SFT step=500/4376 epoch=0.229 loss=1.2339 260618-12:04:39 (UTC+8)260618-12:04:39 (UTC+8)
52P1 SFT step=490/4376 epoch=0.224 loss=1.3851 260618-12:02:05 (UTC+8)260618-12:02:06 (UTC+8)
51P1 SFT step=480/4376 epoch=0.219 loss=1.3037 260618-11:59:32 (UTC+8)260618-11:59:33 (UTC+8)
50P1 SFT step=470/4376 epoch=0.215 loss=1.3623 260618-11:57:00 (UTC+8)260618-11:57:02 (UTC+8)
49P1 SFT step=460/4376 epoch=0.210 loss=1.3872 260618-11:54:28 (UTC+8)260618-11:54:29 (UTC+8)
48P1 SFT step=450/4376 epoch=0.206 loss=1.3548 260618-11:51:57 (UTC+8)260618-11:51:58 (UTC+8)
47P1 SFT step=440/4376 epoch=0.201 loss=1.4325 260618-11:49:24 (UTC+8)260618-11:49:25 (UTC+8)
46P1 SFT step=430/4376 epoch=0.197 loss=1.3864 260618-11:46:42 (UTC+8)260618-11:46:43 (UTC+8)
45P1 SFT step=420/4376 epoch=0.192 loss=1.4021 260618-11:44:11 (UTC+8)260618-11:44:11 (UTC+8)
44P1 SFT step=410/4376 epoch=0.187 loss=1.3720 260618-11:41:39 (UTC+8)260618-11:41:40 (UTC+8)
43P1 SFT step=400/4376 epoch=0.183 loss=1.5016 260618-11:39:09 (UTC+8)260618-11:39:10 (UTC+8)
42P1 SFT step=390/4376 epoch=0.178 loss=1.4075 260618-11:36:28 (UTC+8)260618-11:36:30 (UTC+8)
41P1 SFT step=380/4376 epoch=0.174 loss=1.4972 260618-11:33:55 (UTC+8)260618-11:33:55 (UTC+8)
40P1 SFT step=370/4376 epoch=0.169 loss=1.4404 260618-11:31:22 (UTC+8)260618-11:31:23 (UTC+8)
39P1 SFT step=360/4376 epoch=0.165 loss=1.4895 260618-11:28:47 (UTC+8)260618-11:28:47 (UTC+8)
38P1 SFT step=350/4376 epoch=0.160 loss=1.5376 260618-11:26:19 (UTC+8)260618-11:26:20 (UTC+8)
37P1 SFT step=340/4376 epoch=0.155 loss=1.5458 260618-11:23:46 (UTC+8)260618-11:23:47 (UTC+8)
36P1 SFT step=330/4376 epoch=0.151 loss=1.5492 260618-11:21:08 (UTC+8)260618-11:21:09 (UTC+8)
35P1 SFT step=320/4376 epoch=0.146 loss=1.5715 260618-11:18:35 (UTC+8)260618-11:18:36 (UTC+8)
34P1 SFT step=310/4376 epoch=0.142 loss=1.5725 260618-11:15:57 (UTC+8)260618-11:15:58 (UTC+8)
33P1 SFT step=300/4376 epoch=0.137 loss=1.5582 260618-11:13:29 (UTC+8)260618-11:13:29 (UTC+8)
32P1 SFT step=290/4376 epoch=0.133 loss=1.6676 260618-11:10:51 (UTC+8)260618-11:10:52 (UTC+8)
31P1 SFT step=280/4376 epoch=0.128 loss=1.7779 260618-11:08:23 (UTC+8)260618-11:08:24 (UTC+8)
30P1 SFT step=270/4376 epoch=0.123 loss=1.7396 260618-11:05:46 (UTC+8)260618-11:05:48 (UTC+8)
29P1 SFT step=260/4376 epoch=0.119 loss=1.6711 260618-11:03:13 (UTC+8)260618-11:03:14 (UTC+8)
28P1 SFT step=250/4376 epoch=0.114 loss=1.6861 260618-11:00:41 (UTC+8)260618-11:00:43 (UTC+8)
27P1 SFT step=240/4376 epoch=0.110 loss=1.7632 260618-10:58:11 (UTC+8)260618-10:58:12 (UTC+8)
26P1 SFT step=230/4376 epoch=0.105 loss=1.7402 260618-10:55:39 (UTC+8)260618-10:55:39 (UTC+8)
25P1 SFT step=220/4376 epoch=0.101 loss=1.7577 260618-10:53:07 (UTC+8)260618-10:53:08 (UTC+8)
24P1 SFT step=210/4376 epoch=0.096 loss=1.8835 260618-10:50:34 (UTC+8)260618-10:50:36 (UTC+8)
23P1 SFT step=200/4376 epoch=0.091 loss=1.9860 260618-10:48:02 (UTC+8)260618-10:48:05 (UTC+8)
22P1 SFT step=190/4376 epoch=0.087 loss=1.9962 260618-10:45:22 (UTC+8)260618-10:45:22 (UTC+8)
21P1 SFT step=180/4376 epoch=0.082 loss=2.0062 260618-10:42:54 (UTC+8)260618-10:42:56 (UTC+8)
20P1 SFT step=170/4376 epoch=0.078 loss=2.0061 260618-10:40:22 (UTC+8)260618-10:40:25 (UTC+8)
19P1 SFT step=160/4376 epoch=0.073 loss=2.0878 260618-10:37:57 (UTC+8)260618-10:37:57 (UTC+8)
18P1 SFT step=150/4376 epoch=0.069 loss=2.1459 260618-10:35:28 (UTC+8)260618-10:35:29 (UTC+8)
17P1 SFT step=140/4376 epoch=0.064 loss=2.1682 260618-10:32:58 (UTC+8)260618-10:32:59 (UTC+8)
16P1 SFT step=130/4376 epoch=0.059 loss=2.2304 260618-10:30:23 (UTC+8)260618-10:30:25 (UTC+8)
15P1 SFT step=120/4376 epoch=0.055 loss=2.2994 260618-10:27:42 (UTC+8)260618-10:27:43 (UTC+8)
14P1 SFT step=110/4376 epoch=0.050 loss=2.4236 260618-10:25:02 (UTC+8)260618-10:25:05 (UTC+8)
13P1 SFT step=100/4376 epoch=0.046 loss=2.5100 260618-10:22:28 (UTC+8)260618-10:22:29 (UTC+8)
12P1 SFT step=90/4376 epoch=0.041 loss=2.6084 260618-10:19:55 (UTC+8)260618-10:19:57 (UTC+8)
11P1 SFT step=80/4376 epoch=0.037 loss=2.5878 260618-10:17:24 (UTC+8)260618-10:17:26 (UTC+8)
10P1 SFT step=70/4376 epoch=0.032 loss=2.7142 260618-10:14:53 (UTC+8)260618-10:14:55 (UTC+8)
9P1 SFT step=60/4376 epoch=0.027 loss=2.7902 260618-10:12:15 (UTC+8)260618-10:12:17 (UTC+8)
8P1 SFT step=50/4376 epoch=0.023 loss=2.8806 260618-10:09:42 (UTC+8)260618-10:09:44 (UTC+8)
7P1 SFT step=40/4376 epoch=0.018 loss=3.0956 260618-10:07:11 (UTC+8)260618-10:07:12 (UTC+8)
6P1 SFT step=30/4376 epoch=0.014 loss=3.3241 260618-10:04:32 (UTC+8)260618-10:04:34 (UTC+8)
5P1 SFT step=20/4376 epoch=0.009 loss=3.5500 260618-10:02:00 (UTC+8)260618-10:02:01 (UTC+8)
4P1 SFT step=10/4376 epoch=0.005 loss=3.6774 260618-09:59:31 (UTC+8)260618-09:59:33 (UTC+8)
3P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260618-09:54:15 (UTC+8)260618-09:54:16 (UTC+8)
2P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260618-09:54:03 (UTC+8)260618-09:54:04 (UTC+8)
1P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260618-09:54:02 (UTC+8)260618-09:54:02 (UTC+8)
#07

Wiki-CS9999MultiSeed

▦ table
last update
260619-16:05:54
records
2
type
text
latest
P5 Phase1-only cache ready: /media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Wiki-CS_9999/Data_Cache/phase1_cache_wikics_bestVal.pt 260619-16:05:52 (UTC+8)
ID数值接收时间
2P5 Phase1-only cache ready: /media/ps/M/lzx/ORTHRUS/SubExperiment/20260618_MultiSeed/Wiki-CS_9999/Data_Cache/phase1_cache_wikics_bestVal.pt 260619-16:05:52 (UTC+8)260619-16:05:54 (UTC+8)
1P5 Phase1-only cache build start: seed=3047 epochs=600 device=cuda:0 260619-16:01:50 (UTC+8)260619-16:01:51 (UTC+8)
#08

Wiki-CSOrthrus

▦ table
last update
260619-16:05:53
records
1913
type
text
latest
P5 Phase1 完成:best_val_probe_acc=85.04@550 cache=phase1_cache_wikics_bestVal.pt 260619-16:05:52 (UTC+8)
ID数值接收时间
1913P5 Phase1 完成:best_val_probe_acc=85.04@550 cache=phase1_cache_wikics_bestVal.pt 260619-16:05:52 (UTC+8)260619-16:05:53 (UTC+8)
1912P5 Phase1 epoch=600/600 val_probe_acc=84.98 best=85.04@550 260619-16:05:49 (UTC+8)260619-16:05:50 (UTC+8)
1911P5 Phase1 epoch=550/600 val_probe_acc=85.04 best=85.04@550 260619-16:05:30 (UTC+8)260619-16:05:30 (UTC+8)
1910P5 Phase1 epoch=525/600 val_probe_acc=85.01 best=85.01@525 260619-16:05:19 (UTC+8)260619-16:05:20 (UTC+8)
1909P5 Phase1 epoch=500/600 val_probe_acc=84.94 best=84.94@475 260619-16:05:09 (UTC+8)260619-16:05:10 (UTC+8)
1908P5 Phase1 epoch=475/600 val_probe_acc=84.94 best=84.94@475 260619-16:04:58 (UTC+8)260619-16:04:59 (UTC+8)
1907P5 Phase1 epoch=400/600 val_probe_acc=84.53 best=84.80@250 260619-16:04:30 (UTC+8)260619-16:04:31 (UTC+8)
1906P5 Phase1 epoch=300/600 val_probe_acc=83.23 best=84.80@250 260619-16:03:54 (UTC+8)260619-16:03:55 (UTC+8)
1905P5 Phase1 epoch=250/600 val_probe_acc=84.80 best=84.80@250 260619-16:03:35 (UTC+8)260619-16:03:36 (UTC+8)
1904P5 Phase1 epoch=225/600 val_probe_acc=84.43 best=84.43@225 260619-16:03:25 (UTC+8)260619-16:03:26 (UTC+8)
1903P5 Phase1 epoch=200/600 val_probe_acc=83.21 best=83.32@175 260619-16:03:16 (UTC+8)260619-16:03:16 (UTC+8)
1902P5 Phase1 epoch=175/600 val_probe_acc=83.32 best=83.32@175 260619-16:03:05 (UTC+8)260619-16:03:07 (UTC+8)
1901P5 Phase1 epoch=150/600 val_probe_acc=80.02 best=80.02@150 260619-16:02:55 (UTC+8)260619-16:02:57 (UTC+8)
1900P5 Phase1 epoch=125/600 val_probe_acc=79.78 best=79.78@125 260619-16:02:46 (UTC+8)260619-16:02:46 (UTC+8)
1899P5 Phase1 epoch=100/600 val_probe_acc=78.80 best=78.80@100 260619-16:02:34 (UTC+8)260619-16:02:35 (UTC+8)
1898P5 Phase1 epoch=75/600 val_probe_acc=77.32 best=77.32@75 260619-16:02:24 (UTC+8)260619-16:02:25 (UTC+8)
1897P5 Phase1 epoch=50/600 val_probe_acc=70.34 best=70.34@50 260619-16:02:14 (UTC+8)260619-16:02:15 (UTC+8)
1896P5 Phase1 epoch=25/600 val_probe_acc=53.07 best=53.07@25 260619-16:02:03 (UTC+8)260619-16:02:05 (UTC+8)
1895P5 Phase1 epoch=1/600 val_probe_acc=22.39 best=22.39@1 260619-16:01:54 (UTC+8)260619-16:01:55 (UTC+8)
1894P5 Phase1 启动:三力解耦 L26 mean_last32 KM bank,按 best-val 保存 cache 260619-16:01:50 (UTC+8)260619-16:01:51 (UTC+8)
1893P3 完成:KM bank sanity valid_mean=4.00 norm_mean=8.17 260619-16:01:45 (UTC+8)260619-16:01:46 (UTC+8)
1892P3 启动:检查 L26 mean_last32 KM hidden bank 260619-16:01:43 (UTC+8)260619-16:01:44 (UTC+8)
1891P4 完成:L26 mean_last32 KM bank 已写入 embedding_bank,hidden_dim=4096 260619-16:01:37 (UTC+8)260619-16:01:38 (UTC+8)
1890P4 hidden 提取进度:46804/46804 prompts 260619-16:01:32 (UTC+8)260619-16:01:32 (UTC+8)
1889P4 hidden 提取进度:46000/46804 prompts 260619-15:52:47 (UTC+8)260619-15:52:48 (UTC+8)
1888P4 hidden 提取进度:45000/46804 prompts 260619-15:41:52 (UTC+8)260619-15:41:53 (UTC+8)
1887P4 hidden 提取进度:44000/46804 prompts 260619-15:31:16 (UTC+8)260619-15:31:18 (UTC+8)
1886P4 hidden 提取进度:43000/46804 prompts 260619-15:20:40 (UTC+8)260619-15:20:41 (UTC+8)
1885P4 hidden 提取进度:42000/46804 prompts 260619-15:12:10 (UTC+8)260619-15:12:11 (UTC+8)
1884P4 hidden 提取进度:41000/46804 prompts 260619-15:04:30 (UTC+8)260619-15:04:31 (UTC+8)
1883P4 hidden 提取进度:40000/46804 prompts 260619-14:57:58 (UTC+8)260619-14:57:59 (UTC+8)
1882P4 hidden 提取进度:39000/46804 prompts 260619-14:52:09 (UTC+8)260619-14:52:09 (UTC+8)
1881P4 hidden 提取进度:38000/46804 prompts 260619-14:46:19 (UTC+8)260619-14:46:20 (UTC+8)
1880P4 hidden 提取进度:37000/46804 prompts 260619-14:40:26 (UTC+8)260619-14:40:27 (UTC+8)
1879P4 hidden 提取进度:36000/46804 prompts 260619-14:34:37 (UTC+8)260619-14:34:38 (UTC+8)
1878P4 hidden 提取进度:35000/46804 prompts 260619-14:28:45 (UTC+8)260619-14:28:46 (UTC+8)
1877P4 hidden 提取进度:34000/46804 prompts 260619-14:22:28 (UTC+8)260619-14:22:29 (UTC+8)
1876P4 hidden 提取进度:33000/46804 prompts 260619-14:16:10 (UTC+8)260619-14:16:11 (UTC+8)
1875P4 hidden 提取进度:32000/46804 prompts 260619-14:09:54 (UTC+8)260619-14:09:54 (UTC+8)
1874P4 hidden 提取进度:31000/46804 prompts 260619-14:03:42 (UTC+8)260619-14:03:43 (UTC+8)
1873P4 hidden 提取进度:30000/46804 prompts 260619-13:57:34 (UTC+8)260619-13:57:36 (UTC+8)
1872P4 hidden 提取进度:29000/46804 prompts 260619-13:51:20 (UTC+8)260619-13:51:21 (UTC+8)
1871P4 hidden 提取进度:28000/46804 prompts 260619-13:45:10 (UTC+8)260619-13:45:11 (UTC+8)
1870P4 hidden 提取进度:27000/46804 prompts 260619-13:38:55 (UTC+8)260619-13:38:56 (UTC+8)
1869P4 hidden 提取进度:26000/46804 prompts 260619-13:32:47 (UTC+8)260619-13:32:48 (UTC+8)
1868P4 hidden 提取进度:25000/46804 prompts 260619-13:26:30 (UTC+8)260619-13:26:31 (UTC+8)
1867P4 hidden 提取进度:24000/46804 prompts 260619-13:19:26 (UTC+8)260619-13:20:20 (UTC+8)
1866P4 hidden 提取进度:23000/46804 prompts 260619-13:13:36 (UTC+8)260619-13:14:16 (UTC+8)
1865P4 hidden 提取进度:22000/46804 prompts 260619-13:07:59 (UTC+8)260619-13:08:24 (UTC+8)
1864P4 hidden 提取进度:21000/46804 prompts 260619-13:02:20 (UTC+8)260619-13:02:31 (UTC+8)
1863P4 hidden 提取进度:20000/46804 prompts 260619-12:56:38 (UTC+8)260619-12:56:39 (UTC+8)
1862P4 hidden 提取进度:19000/46804 prompts 260619-12:50:48 (UTC+8)260619-12:50:49 (UTC+8)
1861P4 hidden 提取进度:18000/46804 prompts 260619-12:45:04 (UTC+8)260619-12:45:04 (UTC+8)
1860P4 hidden 提取进度:17000/46804 prompts 260619-12:39:15 (UTC+8)260619-12:39:16 (UTC+8)
1859P4 hidden 提取进度:16000/46804 prompts 260619-12:33:32 (UTC+8)260619-12:33:33 (UTC+8)
1858P4 hidden 提取进度:15000/46804 prompts 260619-12:27:37 (UTC+8)260619-12:27:38 (UTC+8)
1857P4 hidden 提取进度:14000/46804 prompts 260619-12:21:54 (UTC+8)260619-12:21:55 (UTC+8)
1856P4 hidden 提取进度:13000/46804 prompts 260619-12:15:57 (UTC+8)260619-12:15:58 (UTC+8)
1855P4 hidden 提取进度:12000/46804 prompts 260619-12:10:10 (UTC+8)260619-12:10:11 (UTC+8)
1854P4 hidden 提取进度:11000/46804 prompts 260619-12:04:04 (UTC+8)260619-12:04:05 (UTC+8)
1853P4 hidden 提取进度:10000/46804 prompts 260619-11:57:46 (UTC+8)260619-11:57:47 (UTC+8)
1852P4 hidden 提取进度:9000/46804 prompts 260619-11:51:30 (UTC+8)260619-11:51:32 (UTC+8)
1851P4 hidden 提取进度:8000/46804 prompts 260619-11:45:16 (UTC+8)260619-11:45:18 (UTC+8)
1850P4 hidden 提取进度:7000/46804 prompts 260619-11:39:10 (UTC+8)260619-11:39:10 (UTC+8)
1849P4 hidden 提取进度:6000/46804 prompts 260619-11:33:00 (UTC+8)260619-11:33:01 (UTC+8)
1848P4 hidden 提取进度:5000/46804 prompts 260619-11:26:47 (UTC+8)260619-11:26:48 (UTC+8)
1847P4 hidden 提取进度:4000/46804 prompts 260619-11:20:39 (UTC+8)260619-11:20:40 (UTC+8)
1846P4 hidden 提取进度:3000/46804 prompts 260619-11:14:28 (UTC+8)260619-11:14:29 (UTC+8)
1845P4 hidden 提取进度:2000/46804 prompts 260619-11:08:17 (UTC+8)260619-11:08:18 (UTC+8)
1844P4 hidden 提取进度:1000/46804 prompts 260619-11:02:03 (UTC+8)260619-11:02:05 (UTC+8)
1843P4 hidden 提取进度:1/46804 prompts 260619-10:55:55 (UTC+8)260619-10:55:56 (UTC+8)
1842P4 启动:加载 LoRA 生成 KM hidden bank | adapter=SFT_LoRA_Adapters_1781745746314226406 layer=L26 pool=mean_last32 260619-10:55:47 (UTC+8)260619-10:55:48 (UTC+8)
1841P2 完成:SFT/P4 格式一致性通过 adapter=SFT_LoRA_Adapters_1781745746314226406 260619-10:55:42 (UTC+8)260619-10:55:44 (UTC+8)
1840P2 启动:核对 SFT/P4 Alpaca 格式和安全截断 260619-10:55:41 (UTC+8)260619-10:55:42 (UTC+8)
1839P1 完成:LLM SFT adapter=SFT_LoRA_Adapters_1781745746314226406 samples=35000 260619-10:55:34 (UTC+8)260619-10:55:35 (UTC+8)
1838P1 SFT checkpoint:step=4376 epoch=2.000 260619-10:55:32 (UTC+8)260619-10:55:33 (UTC+8)
1837P1 SFT step=4370/4376 epoch=1.997 loss=0.3285 260619-10:54:06 (UTC+8)260619-10:54:07 (UTC+8)
1836P1 SFT step=4360/4376 epoch=1.993 loss=0.3923 260619-10:51:37 (UTC+8)260619-10:51:39 (UTC+8)
1835P1 SFT step=4350/4376 epoch=1.988 loss=0.3838 260619-10:48:57 (UTC+8)260619-10:48:58 (UTC+8)
1834P1 SFT step=4340/4376 epoch=1.984 loss=0.3487 260619-10:46:21 (UTC+8)260619-10:46:22 (UTC+8)
1833P1 SFT step=4330/4376 epoch=1.979 loss=0.4101 260619-10:43:42 (UTC+8)260619-10:43:42 (UTC+8)
1832P1 SFT step=4320/4376 epoch=1.975 loss=0.3905 260619-10:41:08 (UTC+8)260619-10:41:09 (UTC+8)
1831P1 SFT step=4310/4376 epoch=1.970 loss=0.3338 260619-10:38:37 (UTC+8)260619-10:38:38 (UTC+8)
1830P1 SFT step=4300/4376 epoch=1.965 loss=0.4073 260619-10:36:04 (UTC+8)260619-10:36:05 (UTC+8)
1829P1 SFT step=4290/4376 epoch=1.961 loss=0.3393 260619-10:33:32 (UTC+8)260619-10:33:32 (UTC+8)
1828P1 SFT step=4280/4376 epoch=1.956 loss=0.3845 260619-10:31:03 (UTC+8)260619-10:31:05 (UTC+8)
1827P1 SFT step=4270/4376 epoch=1.952 loss=0.4266 260619-10:28:32 (UTC+8)260619-10:28:33 (UTC+8)
1826P1 SFT step=4260/4376 epoch=1.947 loss=0.4145 260619-10:25:51 (UTC+8)260619-10:25:52 (UTC+8)
1825P1 SFT step=4250/4376 epoch=1.943 loss=0.4073 260619-10:23:17 (UTC+8)260619-10:23:17 (UTC+8)
1824P1 SFT step=4240/4376 epoch=1.938 loss=0.3793 260619-10:20:40 (UTC+8)260619-10:20:42 (UTC+8)
1823P1 SFT step=4230/4376 epoch=1.933 loss=0.4116 260619-10:18:03 (UTC+8)260619-10:18:05 (UTC+8)
1822P1 SFT step=4220/4376 epoch=1.929 loss=0.4051 260619-10:15:28 (UTC+8)260619-10:15:29 (UTC+8)
1821P1 SFT step=4210/4376 epoch=1.924 loss=0.3583 260619-10:12:59 (UTC+8)260619-10:12:59 (UTC+8)
1820P1 SFT step=4200/4376 epoch=1.920 loss=0.3555 260619-10:10:31 (UTC+8)260619-10:10:32 (UTC+8)
1819P1 SFT step=4190/4376 epoch=1.915 loss=0.4155 260619-10:08:04 (UTC+8)260619-10:08:05 (UTC+8)
1818P1 SFT step=4180/4376 epoch=1.911 loss=0.3658 260619-10:05:37 (UTC+8)260619-10:05:38 (UTC+8)
1817P1 SFT step=4170/4376 epoch=1.906 loss=0.4150 260619-10:03:13 (UTC+8)260619-10:03:14 (UTC+8)
1816P1 SFT step=4160/4376 epoch=1.901 loss=0.3451 260619-10:00:35 (UTC+8)260619-10:00:36 (UTC+8)
1815P1 SFT step=4150/4376 epoch=1.897 loss=0.3527 260619-09:57:58 (UTC+8)260619-09:58:00 (UTC+8)
1814P1 SFT step=4140/4376 epoch=1.892 loss=0.3923 260619-09:55:23 (UTC+8)260619-09:55:23 (UTC+8)
1813P1 SFT step=4130/4376 epoch=1.888 loss=0.4175 260619-09:52:49 (UTC+8)260619-09:52:51 (UTC+8)
1812P1 SFT step=4120/4376 epoch=1.883 loss=0.3982 260619-09:50:19 (UTC+8)260619-09:50:20 (UTC+8)
1811P1 SFT step=4110/4376 epoch=1.879 loss=0.3866 260619-09:47:50 (UTC+8)260619-09:47:52 (UTC+8)
1810P1 SFT step=4100/4376 epoch=1.874 loss=0.3782 260619-09:45:19 (UTC+8)260619-09:45:21 (UTC+8)
1809P1 SFT step=4090/4376 epoch=1.869 loss=0.3848 260619-09:42:51 (UTC+8)260619-09:42:51 (UTC+8)
1808P1 SFT step=4080/4376 epoch=1.865 loss=0.3623 260619-09:40:20 (UTC+8)260619-09:40:21 (UTC+8)
1807P1 SFT step=4070/4376 epoch=1.860 loss=0.3643 260619-09:37:48 (UTC+8)260619-09:37:49 (UTC+8)
1806P1 SFT step=4060/4376 epoch=1.856 loss=0.3973 260619-09:35:16 (UTC+8)260619-09:35:18 (UTC+8)
1805P1 SFT step=4050/4376 epoch=1.851 loss=0.3649 260619-09:32:43 (UTC+8)260619-09:32:44 (UTC+8)
1804P1 SFT step=4040/4376 epoch=1.847 loss=0.4346 260619-09:30:06 (UTC+8)260619-09:30:08 (UTC+8)
1803P1 SFT step=4030/4376 epoch=1.842 loss=0.4047 260619-09:27:32 (UTC+8)260619-09:27:32 (UTC+8)
1802P1 SFT step=4020/4376 epoch=1.837 loss=0.4067 260619-09:24:04 (UTC+8)260619-09:24:58 (UTC+8)
1801P1 SFT step=4010/4376 epoch=1.833 loss=0.3769 260619-09:21:30 (UTC+8)260619-09:22:18 (UTC+8)
1800P1 SFT step=4000/4376 epoch=1.828 loss=0.3824 260619-09:19:02 (UTC+8)260619-09:19:44 (UTC+8)
1799P1 SFT step=3990/4376 epoch=1.824 loss=0.3603 260619-09:16:39 (UTC+8)260619-09:17:15 (UTC+8)
1798P1 SFT step=3980/4376 epoch=1.819 loss=0.3274 260619-09:14:09 (UTC+8)260619-09:14:39 (UTC+8)
1797P1 SFT step=3970/4376 epoch=1.815 loss=0.3800 260619-09:11:48 (UTC+8)260619-09:12:12 (UTC+8)
1796P1 SFT step=3960/4376 epoch=1.810 loss=0.4434 260619-09:09:17 (UTC+8)260619-09:09:35 (UTC+8)
1795P1 SFT step=3950/4376 epoch=1.805 loss=0.3986 260619-09:06:51 (UTC+8)260619-09:07:02 (UTC+8)
1794P1 SFT step=3940/4376 epoch=1.801 loss=0.3828 260619-09:04:24 (UTC+8)260619-09:04:30 (UTC+8)
1793P1 SFT step=3930/4376 epoch=1.796 loss=0.4493 260619-09:01:49 (UTC+8)260619-09:01:51 (UTC+8)
1792P1 SFT step=3920/4376 epoch=1.792 loss=0.3374 260619-08:59:16 (UTC+8)260619-08:59:17 (UTC+8)
1791P1 SFT step=3910/4376 epoch=1.787 loss=0.3660 260619-08:56:42 (UTC+8)260619-08:56:44 (UTC+8)
1790P1 SFT step=3900/4376 epoch=1.783 loss=0.3855 260619-08:54:05 (UTC+8)260619-08:54:06 (UTC+8)
1789P1 SFT step=3890/4376 epoch=1.778 loss=0.3388 260619-08:51:38 (UTC+8)260619-08:51:38 (UTC+8)
1788P1 SFT step=3880/4376 epoch=1.773 loss=0.3958 260619-08:49:08 (UTC+8)260619-08:49:09 (UTC+8)
1787P1 SFT step=3870/4376 epoch=1.769 loss=0.3597 260619-08:46:34 (UTC+8)260619-08:46:35 (UTC+8)
1786P1 SFT step=3860/4376 epoch=1.764 loss=0.4067 260619-08:44:05 (UTC+8)260619-08:44:06 (UTC+8)
1785P1 SFT step=3850/4376 epoch=1.760 loss=0.3850 260619-08:41:25 (UTC+8)260619-08:41:26 (UTC+8)
1784P1 SFT step=3840/4376 epoch=1.755 loss=0.4044 260619-08:38:55 (UTC+8)260619-08:38:57 (UTC+8)
1783P1 SFT step=3830/4376 epoch=1.751 loss=0.3876 260619-08:36:24 (UTC+8)260619-08:36:25 (UTC+8)
1782P1 SFT step=3820/4376 epoch=1.746 loss=0.3962 260619-08:33:51 (UTC+8)260619-08:33:53 (UTC+8)
1781P1 SFT step=3810/4376 epoch=1.741 loss=0.3872 260619-08:31:21 (UTC+8)260619-08:31:22 (UTC+8)
1780P1 SFT step=3800/4376 epoch=1.737 loss=0.3687 260619-08:28:49 (UTC+8)260619-08:28:51 (UTC+8)
1779P1 SFT step=3790/4376 epoch=1.732 loss=0.3451 260619-08:26:14 (UTC+8)260619-08:26:15 (UTC+8)
1778P1 SFT step=3780/4376 epoch=1.728 loss=0.3744 260619-08:23:51 (UTC+8)260619-08:23:52 (UTC+8)
1777P1 SFT step=3770/4376 epoch=1.723 loss=0.3838 260619-08:21:22 (UTC+8)260619-08:21:24 (UTC+8)
1776P1 SFT step=3760/4376 epoch=1.719 loss=0.4325 260619-08:17:58 (UTC+8)260619-08:18:53 (UTC+8)
1775P1 SFT step=3750/4376 epoch=1.714 loss=0.3544 260619-08:15:24 (UTC+8)260619-08:16:13 (UTC+8)
1774P1 SFT step=3740/4376 epoch=1.709 loss=0.3949 260619-08:13:01 (UTC+8)260619-08:13:44 (UTC+8)
1773P1 SFT step=3730/4376 epoch=1.705 loss=0.3863 260619-08:10:32 (UTC+8)260619-08:11:09 (UTC+8)
1772P1 SFT step=3720/4376 epoch=1.700 loss=0.3843 260619-08:08:07 (UTC+8)260619-08:08:38 (UTC+8)
1771P1 SFT step=3710/4376 epoch=1.696 loss=0.3477 260619-08:05:41 (UTC+8)260619-08:06:06 (UTC+8)
1770P1 SFT step=3700/4376 epoch=1.691 loss=0.3776 260619-08:03:11 (UTC+8)260619-08:03:30 (UTC+8)
1769P1 SFT step=3690/4376 epoch=1.687 loss=0.3984 260619-08:00:43 (UTC+8)260619-08:00:56 (UTC+8)
1768P1 SFT step=3680/4376 epoch=1.682 loss=0.3958 260619-07:58:16 (UTC+8)260619-07:58:22 (UTC+8)
1767P1 SFT step=3670/4376 epoch=1.677 loss=0.3759 260619-07:55:47 (UTC+8)260619-07:55:49 (UTC+8)
1766P1 SFT step=3660/4376 epoch=1.673 loss=0.3791 260619-07:53:17 (UTC+8)260619-07:53:18 (UTC+8)
1765P1 SFT step=3650/4376 epoch=1.668 loss=0.3803 260619-07:50:42 (UTC+8)260619-07:50:43 (UTC+8)
1764P1 SFT step=3640/4376 epoch=1.664 loss=0.3671 260619-07:48:16 (UTC+8)260619-07:48:18 (UTC+8)
1763P1 SFT step=3630/4376 epoch=1.659 loss=0.3327 260619-07:45:52 (UTC+8)260619-07:45:53 (UTC+8)
1762P1 SFT step=3620/4376 epoch=1.655 loss=0.3671 260619-07:43:24 (UTC+8)260619-07:43:25 (UTC+8)
1761P1 SFT step=3610/4376 epoch=1.650 loss=0.4416 260619-07:40:53 (UTC+8)260619-07:40:55 (UTC+8)
1760P1 SFT step=3600/4376 epoch=1.645 loss=0.3578 260619-07:38:22 (UTC+8)260619-07:38:23 (UTC+8)
1759P1 SFT step=3590/4376 epoch=1.641 loss=0.3604 260619-07:35:51 (UTC+8)260619-07:35:53 (UTC+8)
1758P1 SFT step=3580/4376 epoch=1.636 loss=0.3710 260619-07:33:16 (UTC+8)260619-07:33:17 (UTC+8)
1757P1 SFT step=3570/4376 epoch=1.632 loss=0.3251 260619-07:30:45 (UTC+8)260619-07:30:47 (UTC+8)
1756P1 SFT step=3560/4376 epoch=1.627 loss=0.4175 260619-07:27:18 (UTC+8)260619-07:28:12 (UTC+8)
1755P1 SFT step=3550/4376 epoch=1.623 loss=0.4127 260619-07:24:45 (UTC+8)260619-07:25:33 (UTC+8)
1754P1 SFT step=3540/4376 epoch=1.618 loss=0.3570 260619-07:22:17 (UTC+8)260619-07:22:59 (UTC+8)
1753P1 SFT step=3530/4376 epoch=1.613 loss=0.4003 260619-07:19:58 (UTC+8)260619-07:20:34 (UTC+8)
1752P1 SFT step=3520/4376 epoch=1.609 loss=0.3760 260619-07:17:38 (UTC+8)260619-07:18:08 (UTC+8)
1751P1 SFT step=3510/4376 epoch=1.604 loss=0.3917 260619-07:15:09 (UTC+8)260619-07:15:33 (UTC+8)
1750P1 SFT step=3500/4376 epoch=1.600 loss=0.3779 260619-07:12:40 (UTC+8)260619-07:12:58 (UTC+8)
1749P1 SFT step=3490/4376 epoch=1.595 loss=0.3838 260619-07:10:12 (UTC+8)260619-07:10:23 (UTC+8)
1748P1 SFT step=3480/4376 epoch=1.591 loss=0.3874 260619-07:07:54 (UTC+8)260619-07:07:59 (UTC+8)
1747P1 SFT step=3470/4376 epoch=1.586 loss=0.3917 260619-07:05:30 (UTC+8)260619-07:05:30 (UTC+8)
1746P1 SFT step=3460/4376 epoch=1.581 loss=0.3770 260619-07:02:58 (UTC+8)260619-07:02:58 (UTC+8)
1745P1 SFT step=3450/4376 epoch=1.577 loss=0.3612 260619-07:00:20 (UTC+8)260619-07:00:22 (UTC+8)
1744P1 SFT step=3440/4376 epoch=1.572 loss=0.4395 260619-06:57:51 (UTC+8)260619-06:57:52 (UTC+8)
1743P1 SFT step=3430/4376 epoch=1.568 loss=0.4289 260619-06:55:15 (UTC+8)260619-06:55:16 (UTC+8)
1742P1 SFT step=3420/4376 epoch=1.563 loss=0.4487 260619-06:52:53 (UTC+8)260619-06:52:53 (UTC+8)
1741P1 SFT step=3410/4376 epoch=1.559 loss=0.4169 260619-06:50:15 (UTC+8)260619-06:50:16 (UTC+8)
1740P1 SFT step=3400/4376 epoch=1.554 loss=0.4253 260619-06:47:39 (UTC+8)260619-06:47:40 (UTC+8)
1739P1 SFT step=3390/4376 epoch=1.549 loss=0.3186 260619-06:45:05 (UTC+8)260619-06:45:06 (UTC+8)
1738P1 SFT step=3380/4376 epoch=1.545 loss=0.4212 260619-06:42:35 (UTC+8)260619-06:42:36 (UTC+8)
1737P1 SFT step=3370/4376 epoch=1.540 loss=0.4244 260619-06:40:07 (UTC+8)260619-06:40:09 (UTC+8)
1736P1 SFT step=3360/4376 epoch=1.536 loss=0.4284 260619-06:37:35 (UTC+8)260619-06:37:36 (UTC+8)
1735P1 SFT step=3350/4376 epoch=1.531 loss=0.4090 260619-06:34:58 (UTC+8)260619-06:34:59 (UTC+8)
1734P1 SFT step=3340/4376 epoch=1.527 loss=0.5014 260619-06:32:22 (UTC+8)260619-06:32:23 (UTC+8)
1733P1 SFT step=3330/4376 epoch=1.522 loss=0.4464 260619-06:29:41 (UTC+8)260619-06:29:42 (UTC+8)
1732P1 SFT step=3320/4376 epoch=1.517 loss=0.3789 260619-06:27:13 (UTC+8)260619-06:27:13 (UTC+8)
1731P1 SFT step=3310/4376 epoch=1.513 loss=0.4033 260619-06:24:43 (UTC+8)260619-06:24:45 (UTC+8)
1730P1 SFT step=3300/4376 epoch=1.508 loss=0.4241 260619-06:22:07 (UTC+8)260619-06:22:08 (UTC+8)
1729P1 SFT step=3290/4376 epoch=1.504 loss=0.4285 260619-06:19:36 (UTC+8)260619-06:19:37 (UTC+8)
1728P1 SFT step=3280/4376 epoch=1.499 loss=0.4749 260619-06:16:57 (UTC+8)260619-06:16:58 (UTC+8)
1727P1 SFT step=3270/4376 epoch=1.495 loss=0.3953 260619-06:14:21 (UTC+8)260619-06:14:22 (UTC+8)
1726P1 SFT step=3260/4376 epoch=1.490 loss=0.4229 260619-06:11:54 (UTC+8)260619-06:11:54 (UTC+8)
1725P1 SFT step=3250/4376 epoch=1.485 loss=0.3949 260619-06:09:24 (UTC+8)260619-06:09:25 (UTC+8)
1724P1 SFT step=3240/4376 epoch=1.481 loss=0.4329 260619-06:06:52 (UTC+8)260619-06:06:54 (UTC+8)
1723P1 SFT step=3230/4376 epoch=1.476 loss=0.4076 260619-06:04:17 (UTC+8)260619-06:04:19 (UTC+8)
1722P1 SFT step=3220/4376 epoch=1.472 loss=0.4629 260619-06:01:50 (UTC+8)260619-06:01:51 (UTC+8)
1721P1 SFT step=3210/4376 epoch=1.467 loss=0.4205 260619-05:58:22 (UTC+8)260619-05:59:20 (UTC+8)
1720P1 SFT step=3200/4376 epoch=1.463 loss=0.4838 260619-05:55:56 (UTC+8)260619-05:56:48 (UTC+8)
1719P1 SFT step=3190/4376 epoch=1.458 loss=0.4403 260619-05:53:31 (UTC+8)260619-05:54:16 (UTC+8)
1718P1 SFT step=3180/4376 epoch=1.453 loss=0.4509 260619-05:51:02 (UTC+8)260619-05:51:41 (UTC+8)
1717P1 SFT step=3170/4376 epoch=1.449 loss=0.3984 260619-05:48:30 (UTC+8)260619-05:49:03 (UTC+8)
1716P1 SFT step=3160/4376 epoch=1.444 loss=0.4463 260619-05:46:02 (UTC+8)260619-05:46:29 (UTC+8)
1715P1 SFT step=3150/4376 epoch=1.440 loss=0.4306 260619-05:43:38 (UTC+8)260619-05:43:59 (UTC+8)
1714P1 SFT step=3140/4376 epoch=1.435 loss=0.4176 260619-05:41:16 (UTC+8)260619-05:41:31 (UTC+8)
1713P1 SFT step=3130/4376 epoch=1.431 loss=0.3966 260619-05:38:56 (UTC+8)260619-05:39:05 (UTC+8)
1712P1 SFT step=3120/4376 epoch=1.426 loss=0.4795 260619-05:36:28 (UTC+8)260619-05:36:31 (UTC+8)
1711P1 SFT step=3110/4376 epoch=1.421 loss=0.4306 260619-05:33:57 (UTC+8)260619-05:33:58 (UTC+8)
1710P1 SFT step=3100/4376 epoch=1.417 loss=0.4374 260619-05:31:27 (UTC+8)260619-05:31:28 (UTC+8)
1709P1 SFT step=3090/4376 epoch=1.412 loss=0.4190 260619-05:28:48 (UTC+8)260619-05:28:50 (UTC+8)
1708P1 SFT step=3080/4376 epoch=1.408 loss=0.4592 260619-05:26:20 (UTC+8)260619-05:26:21 (UTC+8)
1707P1 SFT step=3070/4376 epoch=1.403 loss=0.4488 260619-05:23:44 (UTC+8)260619-05:23:46 (UTC+8)
1706P1 SFT step=3060/4376 epoch=1.399 loss=0.4806 260619-05:21:17 (UTC+8)260619-05:21:18 (UTC+8)
1705P1 SFT step=3050/4376 epoch=1.394 loss=0.4212 260619-05:18:46 (UTC+8)260619-05:18:47 (UTC+8)
1704P1 SFT step=3040/4376 epoch=1.389 loss=0.4374 260619-05:15:14 (UTC+8)260619-05:16:09 (UTC+8)
1703P1 SFT step=3030/4376 epoch=1.385 loss=0.4919 260619-05:12:54 (UTC+8)260619-05:13:42 (UTC+8)
1702P1 SFT step=3020/4376 epoch=1.380 loss=0.4845 260619-05:10:30 (UTC+8)260619-05:11:12 (UTC+8)
1701P1 SFT step=3010/4376 epoch=1.376 loss=0.4696 260619-05:08:02 (UTC+8)260619-05:08:38 (UTC+8)
1700P1 SFT step=3000/4376 epoch=1.371 loss=0.4674 260619-05:05:34 (UTC+8)260619-05:06:04 (UTC+8)
1699P1 SFT step=2990/4376 epoch=1.367 loss=0.3873 260619-05:03:04 (UTC+8)260619-05:03:27 (UTC+8)
1698P1 SFT step=2980/4376 epoch=1.362 loss=0.4680 260619-05:00:44 (UTC+8)260619-05:01:02 (UTC+8)
1697P1 SFT step=2970/4376 epoch=1.357 loss=0.4679 260619-04:58:19 (UTC+8)260619-04:58:31 (UTC+8)
1696P1 SFT step=2960/4376 epoch=1.353 loss=0.4269 260619-04:55:46 (UTC+8)260619-04:55:51 (UTC+8)
1695P1 SFT step=2950/4376 epoch=1.348 loss=0.4436 260619-04:53:14 (UTC+8)260619-04:53:15 (UTC+8)
1694P1 SFT step=2940/4376 epoch=1.344 loss=0.4435 260619-04:50:33 (UTC+8)260619-04:50:34 (UTC+8)
1693P1 SFT step=2930/4376 epoch=1.339 loss=0.4858 260619-04:47:59 (UTC+8)260619-04:48:00 (UTC+8)
1692P1 SFT step=2920/4376 epoch=1.335 loss=0.4588 260619-04:45:24 (UTC+8)260619-04:45:24 (UTC+8)
1691P1 SFT step=2910/4376 epoch=1.330 loss=0.5059 260619-04:42:55 (UTC+8)260619-04:42:56 (UTC+8)
1690P1 SFT step=2900/4376 epoch=1.325 loss=0.4411 260619-04:40:18 (UTC+8)260619-04:40:19 (UTC+8)
1689P1 SFT step=2890/4376 epoch=1.321 loss=0.4814 260619-04:37:44 (UTC+8)260619-04:37:45 (UTC+8)
1688P1 SFT step=2880/4376 epoch=1.316 loss=0.4617 260619-04:35:10 (UTC+8)260619-04:35:11 (UTC+8)
1687P1 SFT step=2870/4376 epoch=1.312 loss=0.5089 260619-04:32:34 (UTC+8)260619-04:32:35 (UTC+8)
1686P1 SFT step=2860/4376 epoch=1.307 loss=0.4440 260619-04:30:02 (UTC+8)260619-04:30:03 (UTC+8)
1685P1 SFT step=2850/4376 epoch=1.303 loss=0.4554 260619-04:27:27 (UTC+8)260619-04:27:28 (UTC+8)
1684P1 SFT step=2840/4376 epoch=1.298 loss=0.4705 260619-04:24:59 (UTC+8)260619-04:25:00 (UTC+8)
1683P1 SFT step=2830/4376 epoch=1.293 loss=0.5026 260619-04:22:27 (UTC+8)260619-04:22:28 (UTC+8)
1682P1 SFT step=2820/4376 epoch=1.289 loss=0.4756 260619-04:19:53 (UTC+8)260619-04:19:55 (UTC+8)
1681P1 SFT step=2810/4376 epoch=1.284 loss=0.4358 260619-04:17:18 (UTC+8)260619-04:17:20 (UTC+8)
1680P1 SFT step=2800/4376 epoch=1.280 loss=0.4818 260619-04:14:50 (UTC+8)260619-04:14:52 (UTC+8)
1679P1 SFT step=2790/4376 epoch=1.275 loss=0.4739 260619-04:12:21 (UTC+8)260619-04:12:21 (UTC+8)
1678P1 SFT step=2780/4376 epoch=1.271 loss=0.5524 260619-04:09:45 (UTC+8)260619-04:09:47 (UTC+8)
1677P1 SFT step=2770/4376 epoch=1.266 loss=0.4625 260619-04:07:08 (UTC+8)260619-04:07:10 (UTC+8)
1676P1 SFT step=2760/4376 epoch=1.261 loss=0.4482 260619-04:04:48 (UTC+8)260619-04:04:50 (UTC+8)
1675P1 SFT step=2750/4376 epoch=1.257 loss=0.5124 260619-04:02:18 (UTC+8)260619-04:02:19 (UTC+8)
1674P1 SFT step=2740/4376 epoch=1.252 loss=0.4730 260619-03:59:49 (UTC+8)260619-03:59:50 (UTC+8)
1673P1 SFT step=2730/4376 epoch=1.248 loss=0.4887 260619-03:57:14 (UTC+8)260619-03:57:15 (UTC+8)
1672P1 SFT step=2720/4376 epoch=1.243 loss=0.4487 260619-03:54:36 (UTC+8)260619-03:54:38 (UTC+8)
1671P1 SFT step=2710/4376 epoch=1.239 loss=0.5182 260619-03:52:05 (UTC+8)260619-03:52:06 (UTC+8)
1670P1 SFT step=2700/4376 epoch=1.234 loss=0.4763 260619-03:49:40 (UTC+8)260619-03:49:40 (UTC+8)
1669P1 SFT step=2690/4376 epoch=1.229 loss=0.5108 260619-03:47:06 (UTC+8)260619-03:47:08 (UTC+8)
1668P1 SFT step=2680/4376 epoch=1.225 loss=0.5214 260619-03:44:33 (UTC+8)260619-03:44:34 (UTC+8)
1667P1 SFT step=2670/4376 epoch=1.220 loss=0.5294 260619-03:41:59 (UTC+8)260619-03:42:01 (UTC+8)
1666P1 SFT step=2660/4376 epoch=1.216 loss=0.4570 260619-03:39:31 (UTC+8)260619-03:39:32 (UTC+8)
1665P1 SFT step=2650/4376 epoch=1.211 loss=0.5592 260619-03:36:48 (UTC+8)260619-03:36:50 (UTC+8)
1664P1 SFT step=2640/4376 epoch=1.207 loss=0.5396 260619-03:34:14 (UTC+8)260619-03:34:15 (UTC+8)
1663P1 SFT step=2630/4376 epoch=1.202 loss=0.5361 260619-03:31:47 (UTC+8)260619-03:31:49 (UTC+8)
1662P1 SFT step=2620/4376 epoch=1.197 loss=0.5064 260619-03:29:22 (UTC+8)260619-03:29:23 (UTC+8)
1661P1 SFT step=2610/4376 epoch=1.193 loss=0.4828 260619-03:26:52 (UTC+8)260619-03:26:52 (UTC+8)
1660P1 SFT step=2600/4376 epoch=1.188 loss=0.5256 260619-03:24:22 (UTC+8)260619-03:24:24 (UTC+8)
1659P1 SFT step=2590/4376 epoch=1.184 loss=0.4859 260619-03:21:49 (UTC+8)260619-03:21:49 (UTC+8)
1658P1 SFT step=2580/4376 epoch=1.179 loss=0.5032 260619-03:19:15 (UTC+8)260619-03:19:17 (UTC+8)
1657P1 SFT step=2570/4376 epoch=1.175 loss=0.5234 260619-03:16:53 (UTC+8)260619-03:16:55 (UTC+8)
1656P1 SFT step=2560/4376 epoch=1.170 loss=0.4812 260619-03:14:15 (UTC+8)260619-03:14:16 (UTC+8)
1655P1 SFT step=2550/4376 epoch=1.165 loss=0.4765 260619-03:11:45 (UTC+8)260619-03:11:46 (UTC+8)
1654P1 SFT step=2540/4376 epoch=1.161 loss=0.5407 260619-03:09:13 (UTC+8)260619-03:09:14 (UTC+8)
1653P1 SFT step=2530/4376 epoch=1.156 loss=0.5877 260619-03:06:42 (UTC+8)260619-03:06:43 (UTC+8)
1652P1 SFT step=2520/4376 epoch=1.152 loss=0.5220 260619-03:04:01 (UTC+8)260619-03:04:03 (UTC+8)
1651P1 SFT step=2510/4376 epoch=1.147 loss=0.5246 260619-03:01:29 (UTC+8)260619-03:01:30 (UTC+8)
1650P1 SFT step=2500/4376 epoch=1.143 loss=0.5078 260619-02:58:57 (UTC+8)260619-02:58:58 (UTC+8)
1649P1 SFT step=2490/4376 epoch=1.138 loss=0.5698 260619-02:56:28 (UTC+8)260619-02:56:29 (UTC+8)
1648P1 SFT step=2480/4376 epoch=1.133 loss=0.5529 260619-02:53:51 (UTC+8)260619-02:53:51 (UTC+8)
1647P1 SFT step=2470/4376 epoch=1.129 loss=0.5254 260619-02:50:23 (UTC+8)260619-02:51:19 (UTC+8)
1646P1 SFT step=2460/4376 epoch=1.124 loss=0.5315 260619-02:48:00 (UTC+8)260619-02:48:50 (UTC+8)
1645P1 SFT step=2450/4376 epoch=1.120 loss=0.5967 260619-02:45:40 (UTC+8)260619-02:46:25 (UTC+8)
1644P1 SFT step=2440/4376 epoch=1.115 loss=0.4851 260619-02:43:13 (UTC+8)260619-02:43:51 (UTC+8)
1643P1 SFT step=2430/4376 epoch=1.111 loss=0.4820 260619-02:40:43 (UTC+8)260619-02:41:15 (UTC+8)
1642P1 SFT step=2420/4376 epoch=1.106 loss=0.5530 260619-02:38:24 (UTC+8)260619-02:38:51 (UTC+8)
1641P1 SFT step=2410/4376 epoch=1.101 loss=0.5176 260619-02:35:51 (UTC+8)260619-02:36:10 (UTC+8)
1640P1 SFT step=2400/4376 epoch=1.097 loss=0.5078 260619-02:33:30 (UTC+8)260619-02:33:44 (UTC+8)
1639P1 SFT step=2390/4376 epoch=1.092 loss=0.5296 260619-02:31:00 (UTC+8)260619-02:31:07 (UTC+8)
1638P1 SFT step=2380/4376 epoch=1.088 loss=0.5620 260619-02:28:35 (UTC+8)260619-02:28:36 (UTC+8)
1637P1 SFT step=2370/4376 epoch=1.083 loss=0.5543 260619-02:26:06 (UTC+8)260619-02:26:06 (UTC+8)
1636P1 SFT step=2360/4376 epoch=1.079 loss=0.5390 260619-02:23:32 (UTC+8)260619-02:23:33 (UTC+8)
1635P1 SFT step=2350/4376 epoch=1.074 loss=0.5606 260619-02:21:00 (UTC+8)260619-02:21:01 (UTC+8)
1634P1 SFT step=2340/4376 epoch=1.069 loss=0.5245 260619-02:18:28 (UTC+8)260619-02:18:30 (UTC+8)
1633P1 SFT step=2330/4376 epoch=1.065 loss=0.5609 260619-02:15:53 (UTC+8)260619-02:15:54 (UTC+8)
1632P1 SFT step=2320/4376 epoch=1.060 loss=0.5253 260619-02:13:30 (UTC+8)260619-02:13:31 (UTC+8)
1631P1 SFT step=2310/4376 epoch=1.056 loss=0.4652 260619-02:11:00 (UTC+8)260619-02:11:01 (UTC+8)
1630P1 SFT step=2300/4376 epoch=1.051 loss=0.5654 260619-02:08:28 (UTC+8)260619-02:08:30 (UTC+8)
1629P1 SFT step=2290/4376 epoch=1.047 loss=0.5722 260619-02:06:00 (UTC+8)260619-02:06:01 (UTC+8)
1628P1 SFT step=2280/4376 epoch=1.042 loss=0.4857 260619-02:03:34 (UTC+8)260619-02:03:34 (UTC+8)
1627P1 SFT step=2270/4376 epoch=1.037 loss=0.5527 260619-02:01:00 (UTC+8)260619-02:01:02 (UTC+8)
1626P1 SFT step=2260/4376 epoch=1.033 loss=0.5843 260619-01:58:30 (UTC+8)260619-01:58:31 (UTC+8)
1625P1 SFT step=2250/4376 epoch=1.028 loss=0.6034 260619-01:55:54 (UTC+8)260619-01:55:55 (UTC+8)
1624P1 SFT step=2240/4376 epoch=1.024 loss=0.5362 260619-01:53:24 (UTC+8)260619-01:53:26 (UTC+8)
1623P1 SFT step=2230/4376 epoch=1.019 loss=0.5734 260619-01:50:51 (UTC+8)260619-01:50:52 (UTC+8)
1622P1 SFT step=2220/4376 epoch=1.015 loss=0.5363 260619-01:48:17 (UTC+8)260619-01:48:19 (UTC+8)
1621P1 SFT step=2210/4376 epoch=1.010 loss=0.5534 260619-01:45:48 (UTC+8)260619-01:45:49 (UTC+8)
1620P1 SFT step=2200/4376 epoch=1.005 loss=0.5168 260619-01:43:18 (UTC+8)260619-01:43:20 (UTC+8)
1619P1 SFT step=2190/4376 epoch=1.001 loss=0.6084 260619-01:40:45 (UTC+8)260619-01:40:46 (UTC+8)
1618P1 SFT checkpoint:step=2188 epoch=1.000 260619-01:40:13 (UTC+8)260619-01:40:14 (UTC+8)
1617P1 SFT step=2180/4376 epoch=0.997 loss=0.5944 260619-01:38:23 (UTC+8)260619-01:38:24 (UTC+8)
1616P1 SFT step=2170/4376 epoch=0.992 loss=0.5963 260619-01:35:49 (UTC+8)260619-01:35:51 (UTC+8)
1615P1 SFT step=2160/4376 epoch=0.987 loss=0.6030 260619-01:33:13 (UTC+8)260619-01:33:14 (UTC+8)
1614P1 SFT step=2150/4376 epoch=0.983 loss=0.6835 260619-01:28:07 (UTC+8)260619-01:28:08 (UTC+8)
1613P1 SFT step=2140/4376 epoch=0.978 loss=0.6442 260619-01:22:28 (UTC+8)260619-01:22:28 (UTC+8)
1612P1 SFT step=2130/4376 epoch=0.974 loss=0.6900 260619-01:16:42 (UTC+8)260619-01:16:43 (UTC+8)
1611P1 SFT step=2120/4376 epoch=0.969 loss=0.6149 260619-01:11:00 (UTC+8)260619-01:11:01 (UTC+8)
1610P1 SFT step=2110/4376 epoch=0.965 loss=0.6450 260619-01:05:14 (UTC+8)260619-01:05:15 (UTC+8)
1609P1 SFT step=2100/4376 epoch=0.960 loss=0.6268 260619-00:59:39 (UTC+8)260619-00:59:40 (UTC+8)
1608P1 SFT step=2090/4376 epoch=0.955 loss=0.6090 260619-00:54:02 (UTC+8)260619-00:54:03 (UTC+8)
1607P1 SFT step=2080/4376 epoch=0.951 loss=0.5828 260619-00:48:14 (UTC+8)260619-00:48:14 (UTC+8)
1606P1 SFT step=2070/4376 epoch=0.946 loss=0.6485 260619-00:41:48 (UTC+8)260619-00:42:39 (UTC+8)
1605P1 SFT step=2060/4376 epoch=0.942 loss=0.7329 260619-00:36:35 (UTC+8)260619-00:37:13 (UTC+8)
1604P1 SFT step=2050/4376 epoch=0.937 loss=0.6710 260619-00:31:05 (UTC+8)260619-00:31:29 (UTC+8)
1603P1 SFT step=2040/4376 epoch=0.933 loss=0.6277 260619-00:25:46 (UTC+8)260619-00:25:58 (UTC+8)
1602P1 SFT step=2030/4376 epoch=0.928 loss=0.7050 260619-00:20:25 (UTC+8)260619-00:20:26 (UTC+8)
1601P1 SFT step=2020/4376 epoch=0.923 loss=0.7087 260619-00:14:51 (UTC+8)260619-00:14:52 (UTC+8)
1600P1 SFT step=2010/4376 epoch=0.919 loss=0.6948 260619-00:09:04 (UTC+8)260619-00:09:05 (UTC+8)
1599P1 SFT step=2000/4376 epoch=0.914 loss=0.6781 260619-00:03:34 (UTC+8)260619-00:03:35 (UTC+8)
1598P1 SFT step=1990/4376 epoch=0.910 loss=0.6310 260618-23:58:31 (UTC+8)260618-23:58:32 (UTC+8)
1597P1 SFT step=1980/4376 epoch=0.905 loss=0.6817 260618-23:53:05 (UTC+8)260618-23:53:06 (UTC+8)
1596P1 SFT step=1970/4376 epoch=0.901 loss=0.6390 260618-23:47:27 (UTC+8)260618-23:47:28 (UTC+8)
1595P1 SFT step=1960/4376 epoch=0.896 loss=0.6213 260618-23:41:36 (UTC+8)260618-23:41:37 (UTC+8)
1594P1 SFT step=1950/4376 epoch=0.891 loss=0.7327 260618-23:35:57 (UTC+8)260618-23:35:58 (UTC+8)
1593P1 SFT step=1940/4376 epoch=0.887 loss=0.6292 260618-23:30:09 (UTC+8)260618-23:30:10 (UTC+8)
1592P1 SFT step=1930/4376 epoch=0.882 loss=0.7236 260618-23:24:37 (UTC+8)260618-23:24:39 (UTC+8)
1591P1 SFT step=1920/4376 epoch=0.878 loss=0.6395 260618-23:19:06 (UTC+8)260618-23:19:07 (UTC+8)
1590P1 SFT step=1910/4376 epoch=0.873 loss=0.7239 260618-23:13:24 (UTC+8)260618-23:13:26 (UTC+8)
1589P1 SFT step=1900/4376 epoch=0.869 loss=0.6322 260618-23:07:41 (UTC+8)260618-23:07:42 (UTC+8)
1588P1 SFT step=1890/4376 epoch=0.864 loss=0.7523 260618-23:02:02 (UTC+8)260618-23:02:03 (UTC+8)
1587P1 SFT step=1880/4376 epoch=0.859 loss=0.7105 260618-22:56:05 (UTC+8)260618-22:56:06 (UTC+8)
1586P1 SFT step=1870/4376 epoch=0.855 loss=0.6580 260618-22:50:33 (UTC+8)260618-22:50:35 (UTC+8)
1585P1 SFT step=1860/4376 epoch=0.850 loss=0.6866 260618-22:44:53 (UTC+8)260618-22:44:54 (UTC+8)
1584P1 SFT step=1850/4376 epoch=0.846 loss=0.7358 260618-22:39:10 (UTC+8)260618-22:39:11 (UTC+8)
1583P1 SFT step=1840/4376 epoch=0.841 loss=0.6400 260618-22:33:33 (UTC+8)260618-22:33:33 (UTC+8)
1582P1 SFT step=1830/4376 epoch=0.837 loss=0.7452 260618-22:28:19 (UTC+8)260618-22:28:21 (UTC+8)
1581P1 SFT step=1820/4376 epoch=0.832 loss=0.6908 260618-22:22:48 (UTC+8)260618-22:22:48 (UTC+8)
1580P1 SFT step=1810/4376 epoch=0.827 loss=0.6363 260618-22:17:11 (UTC+8)260618-22:17:13 (UTC+8)
1579P1 SFT step=1800/4376 epoch=0.823 loss=0.7452 260618-22:11:35 (UTC+8)260618-22:11:36 (UTC+8)
1578P1 SFT step=1790/4376 epoch=0.818 loss=0.7742 260618-22:06:02 (UTC+8)260618-22:06:04 (UTC+8)
1577P1 SFT step=1780/4376 epoch=0.814 loss=0.7377 260618-21:59:24 (UTC+8)260618-22:00:23 (UTC+8)
1576P1 SFT step=1770/4376 epoch=0.809 loss=0.7158 260618-21:54:01 (UTC+8)260618-21:54:47 (UTC+8)
1575P1 SFT step=1760/4376 epoch=0.805 loss=0.6813 260618-21:48:54 (UTC+8)260618-21:49:27 (UTC+8)
1574P1 SFT step=1750/4376 epoch=0.800 loss=0.6846 260618-21:43:32 (UTC+8)260618-21:43:51 (UTC+8)
1573P1 SFT step=1740/4376 epoch=0.795 loss=0.7427 260618-21:37:52 (UTC+8)260618-21:37:57 (UTC+8)
1572P1 SFT step=1730/4376 epoch=0.791 loss=0.6911 260618-21:32:19 (UTC+8)260618-21:32:20 (UTC+8)
1571P1 SFT step=1720/4376 epoch=0.786 loss=0.7199 260618-21:27:09 (UTC+8)260618-21:27:10 (UTC+8)
1570P1 SFT step=1710/4376 epoch=0.782 loss=0.7794 260618-21:21:41 (UTC+8)260618-21:21:43 (UTC+8)
1569P1 SFT step=1700/4376 epoch=0.777 loss=0.7193 260618-21:16:07 (UTC+8)260618-21:16:08 (UTC+8)
1568P1 SFT step=1690/4376 epoch=0.773 loss=0.7487 260618-21:10:15 (UTC+8)260618-21:10:17 (UTC+8)
1567P1 SFT step=1680/4376 epoch=0.768 loss=0.7068 260618-21:03:58 (UTC+8)260618-21:04:49 (UTC+8)
1566P1 SFT step=1670/4376 epoch=0.763 loss=0.7570 260618-20:58:17 (UTC+8)260618-20:58:54 (UTC+8)
1565P1 SFT step=1660/4376 epoch=0.759 loss=0.7489 260618-20:52:48 (UTC+8)260618-20:53:11 (UTC+8)
1564P1 SFT step=1650/4376 epoch=0.754 loss=0.7580 260618-20:46:39 (UTC+8)260618-20:46:47 (UTC+8)
1563P1 SFT step=1640/4376 epoch=0.750 loss=0.7527 260618-20:40:44 (UTC+8)260618-20:40:46 (UTC+8)
1562P1 SFT step=1630/4376 epoch=0.745 loss=0.8211 260618-20:34:16 (UTC+8)260618-20:34:18 (UTC+8)
1561P1 SFT step=1620/4376 epoch=0.741 loss=0.7675 260618-20:27:53 (UTC+8)260618-20:27:54 (UTC+8)
1560P1 SFT step=1600/4376 epoch=0.731 loss=0.7707 260618-20:14:43 (UTC+8)260618-20:14:45 (UTC+8)
1559P1 SFT step=1590/4376 epoch=0.727 loss=0.7867 260618-20:08:24 (UTC+8)260618-20:08:25 (UTC+8)
1558P1 SFT step=1580/4376 epoch=0.722 loss=0.7605 260618-20:01:39 (UTC+8)260618-20:01:41 (UTC+8)
1557P1 SFT step=1570/4376 epoch=0.718 loss=0.7717 260618-19:54:55 (UTC+8)260618-19:54:56 (UTC+8)
1556P1 SFT step=1560/4376 epoch=0.713 loss=0.7822 260618-19:48:23 (UTC+8)260618-19:48:25 (UTC+8)
1555P1 SFT step=1550/4376 epoch=0.709 loss=0.8600 260618-19:42:13 (UTC+8)260618-19:42:13 (UTC+8)
1554P1 SFT step=1540/4376 epoch=0.704 loss=0.7264 260618-19:35:31 (UTC+8)260618-19:35:32 (UTC+8)
1553P1 SFT step=1530/4376 epoch=0.699 loss=0.8045 260618-19:28:48 (UTC+8)260618-19:28:49 (UTC+8)
1552P1 SFT step=1520/4376 epoch=0.695 loss=0.8038 260618-19:22:42 (UTC+8)260618-19:22:43 (UTC+8)
1551P1 SFT step=1510/4376 epoch=0.690 loss=0.8451 260618-19:15:52 (UTC+8)260618-19:15:53 (UTC+8)
1550P1 SFT step=1500/4376 epoch=0.686 loss=0.8595 260618-19:08:55 (UTC+8)260618-19:08:56 (UTC+8)
1549P1 SFT step=1490/4376 epoch=0.681 loss=0.8199 260618-19:02:25 (UTC+8)260618-19:02:27 (UTC+8)
1548P1 SFT step=1480/4376 epoch=0.677 loss=0.8018 260618-18:55:40 (UTC+8)260618-18:55:41 (UTC+8)
1547P1 SFT step=1470/4376 epoch=0.672 loss=0.8428 260618-18:48:48 (UTC+8)260618-18:48:49 (UTC+8)
1546P1 SFT step=1460/4376 epoch=0.667 loss=0.8223 260618-18:42:22 (UTC+8)260618-18:42:23 (UTC+8)
1545P1 SFT step=1450/4376 epoch=0.663 loss=0.8140 260618-18:35:53 (UTC+8)260618-18:35:54 (UTC+8)
1544P1 SFT step=1440/4376 epoch=0.658 loss=0.8435 260618-18:29:46 (UTC+8)260618-18:29:47 (UTC+8)
1543P1 SFT step=1430/4376 epoch=0.654 loss=0.7886 260618-18:23:20 (UTC+8)260618-18:23:21 (UTC+8)
1542P1 SFT step=1420/4376 epoch=0.649 loss=0.8723 260618-18:17:04 (UTC+8)260618-18:17:06 (UTC+8)
1541P1 SFT step=1410/4376 epoch=0.645 loss=0.7729 260618-18:10:18 (UTC+8)260618-18:10:20 (UTC+8)
1540P1 SFT step=1400/4376 epoch=0.640 loss=0.8348 260618-18:05:08 (UTC+8)260618-18:05:10 (UTC+8)
1539P1 SFT step=1390/4376 epoch=0.635 loss=0.8871 260618-18:01:15 (UTC+8)260618-18:01:17 (UTC+8)
1538P1 SFT step=1380/4376 epoch=0.631 loss=0.8817 260618-17:57:17 (UTC+8)260618-17:57:17 (UTC+8)
1537P1 SFT step=1370/4376 epoch=0.626 loss=0.8154 260618-17:53:13 (UTC+8)260618-17:53:14 (UTC+8)
1536P1 SFT step=1360/4376 epoch=0.622 loss=0.8709 260618-17:49:36 (UTC+8)260618-17:49:38 (UTC+8)
1535P1 SFT step=1350/4376 epoch=0.617 loss=0.8113 260618-17:45:47 (UTC+8)260618-17:45:47 (UTC+8)
1534P1 SFT step=1340/4376 epoch=0.613 loss=0.7690 260618-17:41:46 (UTC+8)260618-17:41:48 (UTC+8)
1533P1 SFT step=1330/4376 epoch=0.608 loss=0.8819 260618-17:37:50 (UTC+8)260618-17:37:51 (UTC+8)
1532P1 SFT step=1320/4376 epoch=0.603 loss=0.8648 260618-17:33:45 (UTC+8)260618-17:33:45 (UTC+8)
1531P1 SFT step=1310/4376 epoch=0.599 loss=0.8408 260618-17:29:43 (UTC+8)260618-17:29:43 (UTC+8)
1530P1 SFT step=1300/4376 epoch=0.594 loss=0.8514 260618-17:26:06 (UTC+8)260618-17:26:08 (UTC+8)
1529P1 SFT step=1290/4376 epoch=0.590 loss=0.9185 260618-17:22:06 (UTC+8)260618-17:22:07 (UTC+8)
1528P1 SFT step=1280/4376 epoch=0.585 loss=0.7998 260618-17:18:17 (UTC+8)260618-17:18:17 (UTC+8)
1527P1 SFT step=1270/4376 epoch=0.581 loss=0.7770 260618-17:15:08 (UTC+8)260618-17:15:10 (UTC+8)
1526P1 SFT step=1260/4376 epoch=0.576 loss=0.8884 260618-17:11:47 (UTC+8)260618-17:11:48 (UTC+8)
1525P1 SFT step=1250/4376 epoch=0.571 loss=0.8764 260618-17:08:19 (UTC+8)260618-17:08:20 (UTC+8)
1524P1 SFT step=1240/4376 epoch=0.567 loss=0.8708 260618-17:04:40 (UTC+8)260618-17:04:41 (UTC+8)
1523P1 SFT step=1230/4376 epoch=0.562 loss=0.8917 260618-17:00:48 (UTC+8)260618-17:00:49 (UTC+8)
1522P1 SFT step=1220/4376 epoch=0.558 loss=0.9029 260618-16:56:54 (UTC+8)260618-16:56:55 (UTC+8)
1521P1 SFT step=1210/4376 epoch=0.553 loss=0.8468 260618-16:52:58 (UTC+8)260618-16:53:01 (UTC+8)
1520P1 SFT step=1200/4376 epoch=0.549 loss=0.8571 260618-16:49:05 (UTC+8)260618-16:49:07 (UTC+8)
1519P1 SFT step=1190/4376 epoch=0.544 loss=0.9497 260618-16:45:08 (UTC+8)260618-16:45:10 (UTC+8)
1518P1 SFT step=1180/4376 epoch=0.539 loss=0.9767 260618-16:41:27 (UTC+8)260618-16:41:28 (UTC+8)
1517P1 SFT step=1170/4376 epoch=0.535 loss=0.8379 260618-16:37:32 (UTC+8)260618-16:37:33 (UTC+8)
1516P1 SFT step=1160/4376 epoch=0.530 loss=0.8625 260618-16:33:35 (UTC+8)260618-16:33:36 (UTC+8)
1515P1 SFT step=1150/4376 epoch=0.526 loss=0.9344 260618-16:29:43 (UTC+8)260618-16:29:45 (UTC+8)
1514P1 SFT step=1140/4376 epoch=0.521 loss=0.9191 260618-16:25:34 (UTC+8)260618-16:25:35 (UTC+8)
1513P1 SFT step=1130/4376 epoch=0.517 loss=0.8640 260618-16:21:40 (UTC+8)260618-16:21:42 (UTC+8)
1512P1 SFT step=1120/4376 epoch=0.512 loss=0.9412 260618-16:17:59 (UTC+8)260618-16:17:59 (UTC+8)
1511P1 SFT step=1110/4376 epoch=0.507 loss=0.9118 260618-16:14:12 (UTC+8)260618-16:14:13 (UTC+8)
1510P1 SFT step=1100/4376 epoch=0.503 loss=0.9513 260618-16:10:26 (UTC+8)260618-16:10:28 (UTC+8)
1509P1 SFT step=1090/4376 epoch=0.498 loss=1.0048 260618-16:07:53 (UTC+8)260618-16:07:54 (UTC+8)
1508P1 SFT step=1080/4376 epoch=0.494 loss=1.0703 260618-16:05:20 (UTC+8)260618-16:05:22 (UTC+8)
1507P1 SFT step=1070/4376 epoch=0.489 loss=0.8766 260618-16:02:09 (UTC+8)260618-16:02:10 (UTC+8)
1506P1 SFT step=1060/4376 epoch=0.485 loss=0.9155 260618-15:58:39 (UTC+8)260618-15:58:39 (UTC+8)
1505P1 SFT step=1050/4376 epoch=0.480 loss=0.9568 260618-15:55:05 (UTC+8)260618-15:55:05 (UTC+8)
1504P1 SFT step=1040/4376 epoch=0.475 loss=1.0417 260618-15:50:58 (UTC+8)260618-15:51:00 (UTC+8)
1503P1 SFT step=1030/4376 epoch=0.471 loss=0.9917 260618-15:47:05 (UTC+8)260618-15:47:05 (UTC+8)
1502P1 SFT step=1020/4376 epoch=0.466 loss=0.9593 260618-15:43:21 (UTC+8)260618-15:43:22 (UTC+8)
1501P1 SFT step=1010/4376 epoch=0.462 loss=1.0279 260618-15:39:26 (UTC+8)260618-15:39:28 (UTC+8)
1500P1 SFT step=1000/4376 epoch=0.457 loss=1.0942 260618-15:35:42 (UTC+8)260618-15:35:43 (UTC+8)
1499P1 SFT step=990/4376 epoch=0.453 loss=0.9803 260618-15:31:50 (UTC+8)260618-15:31:51 (UTC+8)
1498P1 SFT step=980/4376 epoch=0.448 loss=0.9539 260618-15:27:48 (UTC+8)260618-15:27:49 (UTC+8)
1497P1 SFT step=970/4376 epoch=0.443 loss=0.9957 260618-15:24:00 (UTC+8)260618-15:24:01 (UTC+8)
1496P1 SFT step=960/4376 epoch=0.439 loss=1.0279 260618-15:20:20 (UTC+8)260618-15:20:21 (UTC+8)
1495P1 SFT step=950/4376 epoch=0.434 loss=1.0172 260618-15:16:24 (UTC+8)260618-15:16:26 (UTC+8)
1494P1 SFT step=940/4376 epoch=0.430 loss=0.9378 260618-15:12:30 (UTC+8)260618-15:12:33 (UTC+8)
1493P1 SFT step=930/4376 epoch=0.425 loss=1.0637 260618-15:08:49 (UTC+8)260618-15:08:50 (UTC+8)
1492P1 SFT step=920/4376 epoch=0.421 loss=1.0396 260618-15:04:50 (UTC+8)260618-15:04:51 (UTC+8)
1491P1 SFT step=910/4376 epoch=0.416 loss=1.0128 260618-15:01:14 (UTC+8)260618-15:01:15 (UTC+8)
1490P1 SFT step=900/4376 epoch=0.411 loss=1.0875 260618-14:57:45 (UTC+8)260618-14:57:46 (UTC+8)
1489P1 SFT step=890/4376 epoch=0.407 loss=0.9636 260618-14:54:16 (UTC+8)260618-14:54:20 (UTC+8)
1488P1 SFT step=880/4376 epoch=0.402 loss=1.0246 260618-14:50:19 (UTC+8)260618-14:50:21 (UTC+8)
1487P1 SFT step=870/4376 epoch=0.398 loss=1.0578 260618-14:46:35 (UTC+8)260618-14:46:35 (UTC+8)
1486P1 SFT step=860/4376 epoch=0.393 loss=0.9936 260618-14:42:46 (UTC+8)260618-14:42:48 (UTC+8)
1485P1 SFT step=850/4376 epoch=0.389 loss=1.0819 260618-14:38:51 (UTC+8)260618-14:38:52 (UTC+8)
1484P1 SFT step=840/4376 epoch=0.384 loss=1.0995 260618-14:34:51 (UTC+8)260618-14:34:53 (UTC+8)
1483P1 SFT step=830/4376 epoch=0.379 loss=1.1125 260618-14:31:09 (UTC+8)260618-14:31:10 (UTC+8)
1482P1 SFT step=820/4376 epoch=0.375 loss=1.1093 260618-14:27:02 (UTC+8)260618-14:27:03 (UTC+8)
1481P1 SFT step=810/4376 epoch=0.370 loss=1.0259 260618-14:23:02 (UTC+8)260618-14:23:03 (UTC+8)
1480P1 SFT step=800/4376 epoch=0.366 loss=1.0462 260618-14:19:06 (UTC+8)260618-14:19:07 (UTC+8)
1479P1 SFT step=790/4376 epoch=0.361 loss=0.9919 260618-14:15:04 (UTC+8)260618-14:15:05 (UTC+8)
1478P1 SFT step=780/4376 epoch=0.357 loss=1.1239 260618-14:11:07 (UTC+8)260618-14:11:08 (UTC+8)
1477P1 SFT step=770/4376 epoch=0.352 loss=1.1283 260618-14:07:24 (UTC+8)260618-14:07:25 (UTC+8)
1476P1 SFT step=760/4376 epoch=0.347 loss=1.0133 260618-14:03:29 (UTC+8)260618-14:03:31 (UTC+8)
1475P1 SFT step=750/4376 epoch=0.343 loss=1.1091 260618-13:59:31 (UTC+8)260618-13:59:32 (UTC+8)
1474P1 SFT step=740/4376 epoch=0.338 loss=1.0719 260618-13:56:16 (UTC+8)260618-13:56:17 (UTC+8)
1473P1 SFT step=730/4376 epoch=0.334 loss=1.0965 260618-13:52:55 (UTC+8)260618-13:52:56 (UTC+8)
1472P1 SFT step=720/4376 epoch=0.329 loss=1.0897 260618-13:49:11 (UTC+8)260618-13:49:13 (UTC+8)
1471P1 SFT step=710/4376 epoch=0.325 loss=1.0658 260618-13:45:27 (UTC+8)260618-13:45:28 (UTC+8)
1470P1 SFT step=700/4376 epoch=0.320 loss=1.1708 260618-13:41:36 (UTC+8)260618-13:41:37 (UTC+8)
1469P1 SFT step=690/4376 epoch=0.315 loss=1.1097 260618-13:36:51 (UTC+8)260618-13:37:46 (UTC+8)
1468P1 SFT step=680/4376 epoch=0.311 loss=1.1584 260618-13:32:56 (UTC+8)260618-13:33:41 (UTC+8)
1467P1 SFT step=670/4376 epoch=0.306 loss=1.2763 260618-13:29:16 (UTC+8)260618-13:29:51 (UTC+8)
1466P1 SFT step=660/4376 epoch=0.302 loss=1.1748 260618-13:25:32 (UTC+8)260618-13:25:59 (UTC+8)
1465P1 SFT step=650/4376 epoch=0.297 loss=1.2748 260618-13:21:42 (UTC+8)260618-13:21:59 (UTC+8)
1464P1 SFT step=640/4376 epoch=0.293 loss=1.1833 260618-13:18:02 (UTC+8)260618-13:18:09 (UTC+8)
1463P1 SFT step=630/4376 epoch=0.288 loss=1.2160 260618-13:14:10 (UTC+8)260618-13:14:11 (UTC+8)
1462P1 SFT step=620/4376 epoch=0.283 loss=1.2257 260618-13:10:12 (UTC+8)260618-13:10:13 (UTC+8)
1461P1 SFT step=610/4376 epoch=0.279 loss=1.2092 260618-13:06:29 (UTC+8)260618-13:06:30 (UTC+8)
1460P1 SFT step=600/4376 epoch=0.274 loss=1.1211 260618-13:02:30 (UTC+8)260618-13:02:33 (UTC+8)
1459P1 SFT step=590/4376 epoch=0.270 loss=1.1862 260618-12:58:27 (UTC+8)260618-12:58:29 (UTC+8)
1458P1 SFT step=580/4376 epoch=0.265 loss=1.1762 260618-12:55:16 (UTC+8)260618-12:55:17 (UTC+8)
1457P1 SFT step=570/4376 epoch=0.261 loss=1.2131 260618-12:52:43 (UTC+8)260618-12:52:44 (UTC+8)
1456P1 SFT step=560/4376 epoch=0.256 loss=1.2607 260618-12:50:16 (UTC+8)260618-12:50:17 (UTC+8)
1455P1 SFT step=550/4376 epoch=0.251 loss=1.2529 260618-12:47:40 (UTC+8)260618-12:47:41 (UTC+8)
1454P1 SFT step=540/4376 epoch=0.247 loss=1.3534 260618-12:45:06 (UTC+8)260618-12:45:06 (UTC+8)
1453P1 SFT step=530/4376 epoch=0.242 loss=1.2621 260618-12:42:31 (UTC+8)260618-12:42:32 (UTC+8)
1452P1 SFT step=520/4376 epoch=0.238 loss=1.3143 260618-12:39:59 (UTC+8)260618-12:40:00 (UTC+8)
1451P1 SFT step=510/4376 epoch=0.233 loss=1.3343 260618-12:37:22 (UTC+8)260618-12:37:26 (UTC+8)
1450P1 SFT step=500/4376 epoch=0.229 loss=1.3530 260618-12:34:48 (UTC+8)260618-12:34:49 (UTC+8)
1449P1 SFT step=490/4376 epoch=0.224 loss=1.3893 260618-12:31:31 (UTC+8)260618-12:31:33 (UTC+8)
1448P1 SFT step=480/4376 epoch=0.219 loss=1.3361 260618-12:28:05 (UTC+8)260618-12:28:07 (UTC+8)
1447P1 SFT step=470/4376 epoch=0.215 loss=1.2660 260618-12:24:18 (UTC+8)260618-12:24:18 (UTC+8)
1446P1 SFT step=460/4376 epoch=0.210 loss=1.4279 260618-12:20:26 (UTC+8)260618-12:20:27 (UTC+8)
1445P1 SFT step=450/4376 epoch=0.206 loss=1.3261 260618-12:16:40 (UTC+8)260618-12:16:42 (UTC+8)
1444P1 SFT step=440/4376 epoch=0.201 loss=1.3511 260618-12:12:52 (UTC+8)260618-12:12:53 (UTC+8)
1443P1 SFT step=430/4376 epoch=0.197 loss=1.3759 260618-12:08:49 (UTC+8)260618-12:08:50 (UTC+8)
1442P1 SFT step=420/4376 epoch=0.192 loss=1.4144 260618-12:05:06 (UTC+8)260618-12:05:08 (UTC+8)
1441P1 SFT step=410/4376 epoch=0.187 loss=1.4613 260618-12:01:19 (UTC+8)260618-12:01:20 (UTC+8)
1440P1 SFT step=400/4376 epoch=0.183 loss=1.3893 260618-11:57:15 (UTC+8)260618-11:57:16 (UTC+8)
1439P1 SFT step=390/4376 epoch=0.178 loss=1.4870 260618-11:53:26 (UTC+8)260618-11:53:27 (UTC+8)
1438P1 SFT step=380/4376 epoch=0.174 loss=1.3593 260618-11:49:36 (UTC+8)260618-11:49:37 (UTC+8)
1437P1 SFT step=370/4376 epoch=0.169 loss=1.4798 260618-11:45:36 (UTC+8)260618-11:45:37 (UTC+8)
1436P1 SFT step=360/4376 epoch=0.165 loss=1.4735 260618-11:41:54 (UTC+8)260618-11:41:55 (UTC+8)
1435P1 SFT step=350/4376 epoch=0.160 loss=1.4786 260618-11:38:05 (UTC+8)260618-11:38:06 (UTC+8)
1434P1 SFT step=340/4376 epoch=0.155 loss=1.4984 260618-11:34:10 (UTC+8)260618-11:34:11 (UTC+8)
1433P1 SFT step=330/4376 epoch=0.151 loss=1.4849 260618-11:30:34 (UTC+8)260618-11:30:34 (UTC+8)
1432P1 SFT step=320/4376 epoch=0.146 loss=1.6740 260618-11:27:08 (UTC+8)260618-11:27:08 (UTC+8)
1431P1 SFT step=310/4376 epoch=0.142 loss=1.5641 260618-11:23:30 (UTC+8)260618-11:23:32 (UTC+8)
1430P1 SFT step=300/4376 epoch=0.137 loss=1.6189 260618-11:19:29 (UTC+8)260618-11:19:30 (UTC+8)
1429P1 SFT step=290/4376 epoch=0.133 loss=1.5655 260618-11:15:30 (UTC+8)260618-11:15:31 (UTC+8)
1428P1 SFT step=280/4376 epoch=0.128 loss=1.6213 260618-11:12:00 (UTC+8)260618-11:12:03 (UTC+8)
1427P1 SFT step=270/4376 epoch=0.123 loss=1.6922 260618-11:08:02 (UTC+8)260618-11:08:05 (UTC+8)
1426P1 SFT step=260/4376 epoch=0.119 loss=1.6039 260618-11:04:10 (UTC+8)260618-11:04:11 (UTC+8)
1425P1 SFT step=250/4376 epoch=0.114 loss=1.7571 260618-11:00:28 (UTC+8)260618-11:00:29 (UTC+8)
1424P1 SFT step=240/4376 epoch=0.110 loss=1.7117 260618-10:56:23 (UTC+8)260618-10:56:23 (UTC+8)
1423P1 SFT step=230/4376 epoch=0.105 loss=1.6945 260618-10:52:25 (UTC+8)260618-10:52:26 (UTC+8)
1422P1 SFT step=220/4376 epoch=0.101 loss=1.6771 260618-10:48:38 (UTC+8)260618-10:48:40 (UTC+8)
1421P1 SFT step=210/4376 epoch=0.096 loss=1.8125 260618-10:44:38 (UTC+8)260618-10:44:39 (UTC+8)
1420P1 SFT step=200/4376 epoch=0.091 loss=1.9279 260618-10:40:32 (UTC+8)260618-10:40:35 (UTC+8)
1419P1 SFT step=190/4376 epoch=0.087 loss=1.9150 260618-10:36:47 (UTC+8)260618-10:36:47 (UTC+8)
1418P1 SFT step=180/4376 epoch=0.082 loss=2.0530 260618-10:32:45 (UTC+8)260618-10:32:45 (UTC+8)
1417P1 SFT step=170/4376 epoch=0.078 loss=1.9645 260618-10:28:57 (UTC+8)260618-10:28:58 (UTC+8)
1416P1 SFT step=160/4376 epoch=0.073 loss=2.0993 260618-10:25:38 (UTC+8)260618-10:25:40 (UTC+8)
1415P1 SFT step=150/4376 epoch=0.069 loss=2.0990 260618-10:22:16 (UTC+8)260618-10:22:17 (UTC+8)
1414P1 SFT step=140/4376 epoch=0.064 loss=2.1124 260618-10:18:24 (UTC+8)260618-10:18:26 (UTC+8)
1413P1 SFT step=130/4376 epoch=0.059 loss=2.2059 260618-10:14:20 (UTC+8)260618-10:14:22 (UTC+8)
1412P1 SFT step=120/4376 epoch=0.055 loss=2.3086 260618-10:10:30 (UTC+8)260618-10:10:32 (UTC+8)
1411P1 SFT step=110/4376 epoch=0.050 loss=2.3440 260618-10:06:22 (UTC+8)260618-10:06:23 (UTC+8)
1410P1 SFT step=100/4376 epoch=0.046 loss=2.3849 260618-10:02:23 (UTC+8)260618-10:02:24 (UTC+8)
1409P1 SFT step=90/4376 epoch=0.041 loss=2.4746 260618-09:58:44 (UTC+8)260618-09:58:46 (UTC+8)
1408P1 SFT step=80/4376 epoch=0.037 loss=2.5384 260618-09:54:51 (UTC+8)260618-09:54:52 (UTC+8)
1407P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260618-09:53:29 (UTC+8)260618-09:53:30 (UTC+8)
1406P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260618-09:53:28 (UTC+8)260618-09:53:29 (UTC+8)
1405P1 SFT step=70/4376 epoch=0.032 loss=2.6742 260618-09:50:54 (UTC+8)260618-09:50:56 (UTC+8)
1404P1 SFT step=60/4376 epoch=0.027 loss=2.7997 260618-09:47:14 (UTC+8)260618-09:47:15 (UTC+8)
1403P1 SFT step=50/4376 epoch=0.023 loss=2.9052 260618-09:43:23 (UTC+8)260618-09:43:25 (UTC+8)
1402P1 SFT step=40/4376 epoch=0.018 loss=3.0464 260618-09:39:34 (UTC+8)260618-09:39:36 (UTC+8)
1401P1 SFT step=30/4376 epoch=0.014 loss=3.3150 260618-09:35:47 (UTC+8)260618-09:35:49 (UTC+8)
1400P1 SFT step=20/4376 epoch=0.009 loss=3.5425 260618-09:31:49 (UTC+8)260618-09:31:51 (UTC+8)
1399P1 SFT step=10/4376 epoch=0.005 loss=3.7218 260618-09:27:55 (UTC+8)260618-09:27:57 (UTC+8)
1398P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260618-09:22:21 (UTC+8)260618-09:22:22 (UTC+8)
1397P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260618-09:22:08 (UTC+8)260618-09:22:10 (UTC+8)
1396P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260618-09:22:07 (UTC+8)260618-09:22:08 (UTC+8)
1395P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260618-09:20:33 (UTC+8)260618-09:20:35 (UTC+8)
1394P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260618-09:20:17 (UTC+8)260618-09:20:19 (UTC+8)
1393P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260618-09:20:16 (UTC+8)260618-09:20:17 (UTC+8)
1392P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260618-09:18:58 (UTC+8)260618-09:18:59 (UTC+8)
1391P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260618-09:18:57 (UTC+8)260618-09:18:58 (UTC+8)
1390P5.Distill 完成:preset=best-test val=88.55 test=88.30 epoch=1100 output=/media/ps/M/lzx/ORTHRUS/Wiki-CS/runs_p5/wikics_p5_distill_best-test_1780365333.json 260602-09:57:16 (UTC+8)260602-09:57:18 (UTC+8)
1389P5 Phase1 跳过:复用已有 best-val cache phase1_cache_wikics_bestVal.pt 260602-09:55:34 (UTC+8)260602-09:55:34 (UTC+8)
1388P5.Distill 启动:preset=best-test trial=177 seed=3224 device=cuda:0 260602-09:55:33 (UTC+8)260602-09:55:33 (UTC+8)
1387P5 完成:best_trial=193 best_val=88.89 260602-09:31:08 (UTC+8)260602-09:31:10 (UTC+8)
1386P5 Optuna trial 399 完成:val=88.21 test=86.93 MLP=84.58 GNN=87.74 gateSem=0.469 260602-09:31:07 (UTC+8)260602-09:31:09 (UTC+8)
1385P5 Optuna trial 399 启动:seed=3446 260602-09:29:40 (UTC+8)260602-09:29:41 (UTC+8)
1384P5 Optuna trial 398 完成:val=88.68 test=87.78 MLP=85.01 GNN=87.91 gateSem=0.437 260602-09:29:39 (UTC+8)260602-09:29:40 (UTC+8)
1383P5 Optuna trial 398 启动:seed=3445 260602-09:27:46 (UTC+8)260602-09:27:47 (UTC+8)
1382P5 Optuna trial 397 完成:val=88.55 test=87.61 MLP=84.79 GNN=88.08 gateSem=0.404 260602-09:27:44 (UTC+8)260602-09:27:46 (UTC+8)
1381P5 Optuna trial 397 启动:seed=3444 260602-09:25:50 (UTC+8)260602-09:25:52 (UTC+8)
1380P5 Optuna trial 396 完成:val=88.50 test=87.53 MLP=85.18 GNN=88.21 gateSem=0.445 260602-09:25:49 (UTC+8)260602-09:25:51 (UTC+8)
1379P5 Optuna trial 396 启动:seed=3443 260602-09:24:54 (UTC+8)260602-09:24:55 (UTC+8)
1378P5 Optuna trial 395 启动:seed=3442 260602-09:23:58 (UTC+8)260602-09:24:00 (UTC+8)
1377P5 Optuna trial 394 完成:val=88.63 test=87.83 MLP=85.65 GNN=88.12 gateSem=0.432 260602-09:23:57 (UTC+8)260602-09:23:59 (UTC+8)
1376P5 Optuna trial 393 完成:val=88.68 test=87.95 MLP=85.90 GNN=87.87 gateSem=0.455 260602-09:21:03 (UTC+8)260602-09:21:04 (UTC+8)
1375P5 Optuna trial 393 启动:seed=3440 260602-09:18:39 (UTC+8)260602-09:18:40 (UTC+8)
1374P5 Optuna trial 392 完成:val=87.95 test=87.23 MLP=83.68 GNN=88.12 gateSem=0.455 260602-09:18:37 (UTC+8)260602-09:18:39 (UTC+8)
1373P5 Optuna trial 392 启动:seed=3439 260602-09:17:22 (UTC+8)260602-09:17:23 (UTC+8)
1372P5 Optuna trial 391 完成:val=88.63 test=88.04 MLP=85.78 GNN=87.74 gateSem=0.436 260602-09:17:21 (UTC+8)260602-09:17:22 (UTC+8)
1371P5 Optuna trial 391 启动:seed=3438 260602-09:14:09 (UTC+8)260602-09:14:10 (UTC+8)
1370P5 Optuna trial 390 完成:val=88.55 test=87.91 MLP=85.35 GNN=87.83 gateSem=0.439 260602-09:14:08 (UTC+8)260602-09:14:09 (UTC+8)
1369P5 Optuna trial 390 启动:seed=3437 260602-09:11:33 (UTC+8)260602-09:11:34 (UTC+8)
1368P5 Optuna trial 389 完成:val=88.59 test=87.78 MLP=84.66 GNN=88.21 gateSem=0.425 260602-09:11:32 (UTC+8)260602-09:11:33 (UTC+8)
1367P5 Optuna trial 389 启动:seed=3436 260602-09:09:21 (UTC+8)260602-09:09:22 (UTC+8)
1366P5 Optuna trial 388 完成:val=88.59 test=87.57 MLP=84.92 GNN=88.04 gateSem=0.452 260602-09:09:20 (UTC+8)260602-09:09:20 (UTC+8)
1365P5 Optuna trial 388 启动:seed=3435 260602-09:08:30 (UTC+8)260602-09:08:32 (UTC+8)
1364P5 Optuna trial 387 完成:val=88.12 test=86.97 MLP=83.17 GNN=87.78 gateSem=0.456 260602-09:08:29 (UTC+8)260602-09:08:30 (UTC+8)
1363P5 Optuna trial 387 启动:seed=3434 260602-09:07:36 (UTC+8)260602-09:07:37 (UTC+8)
1362P5 Optuna trial 386 完成:val=88.50 test=87.87 MLP=85.01 GNN=88.08 gateSem=0.456 260602-09:07:35 (UTC+8)260602-09:07:36 (UTC+8)
1361P5 Optuna trial 386 启动:seed=3433 260602-09:05:44 (UTC+8)260602-09:05:46 (UTC+8)
1360P5 Optuna trial 385 完成:val=87.99 test=87.61 MLP=84.75 GNN=88.12 gateSem=0.474 260602-09:05:43 (UTC+8)260602-09:05:45 (UTC+8)
1359P5 Optuna trial 385 启动:seed=3432 260602-09:05:19 (UTC+8)260602-09:05:20 (UTC+8)
1358P5 Optuna trial 384 完成:val=88.63 test=87.70 MLP=86.03 GNN=87.83 gateSem=0.455 260602-09:05:18 (UTC+8)260602-09:05:18 (UTC+8)
1357P5 Optuna trial 384 启动:seed=3431 260602-09:02:43 (UTC+8)260602-09:02:43 (UTC+8)
1356P5 Optuna trial 383 完成:val=88.68 test=87.70 MLP=85.48 GNN=87.70 gateSem=0.462 260602-09:02:42 (UTC+8)260602-09:02:42 (UTC+8)
1355P5 Optuna trial 383 启动:seed=3430 260602-09:00:47 (UTC+8)260602-09:00:49 (UTC+8)
1354P5 Optuna trial 382 完成:val=88.72 test=87.83 MLP=85.73 GNN=88.04 gateSem=0.462 260602-09:00:46 (UTC+8)260602-09:00:48 (UTC+8)
1353P5 Optuna trial 382 启动:seed=3429 260602-08:59:34 (UTC+8)260602-08:59:35 (UTC+8)
1352P5 Optuna trial 381 完成:val=88.42 test=87.06 MLP=84.66 GNN=87.70 gateSem=0.457 260602-08:59:33 (UTC+8)260602-08:59:34 (UTC+8)
1351P5 Optuna trial 381 启动:seed=3428 260602-08:58:16 (UTC+8)260602-08:58:18 (UTC+8)
1350P5 Optuna trial 380 完成:val=88.38 test=87.70 MLP=85.56 GNN=87.78 gateSem=0.443 260602-08:58:15 (UTC+8)260602-08:58:16 (UTC+8)
1349P5 Optuna trial 380 启动:seed=3427 260602-08:54:55 (UTC+8)260602-08:54:57 (UTC+8)
1348P5 Optuna trial 379 完成:val=88.16 test=87.70 MLP=83.64 GNN=88.12 gateSem=0.398 260602-08:54:54 (UTC+8)260602-08:54:56 (UTC+8)
1347P5 Optuna trial 379 启动:seed=3426 260602-08:53:11 (UTC+8)260602-08:53:12 (UTC+8)
1346P5 Optuna trial 378 完成:val=88.38 test=87.65 MLP=85.39 GNN=87.91 gateSem=0.443 260602-08:53:10 (UTC+8)260602-08:53:11 (UTC+8)
1345P5 Optuna trial 378 启动:seed=3425 260602-08:51:36 (UTC+8)260602-08:51:38 (UTC+8)
1344P5 Optuna trial 377 完成:val=88.42 test=87.18 MLP=84.32 GNN=87.83 gateSem=0.472 260602-08:51:35 (UTC+8)260602-08:51:36 (UTC+8)
1343P5 Optuna trial 377 启动:seed=3424 260602-08:50:05 (UTC+8)260602-08:50:07 (UTC+8)
1342P5 Optuna trial 376 完成:val=88.46 test=88.17 MLP=85.48 GNN=87.91 gateSem=0.446 260602-08:50:04 (UTC+8)260602-08:50:06 (UTC+8)
1341P5 Optuna trial 376 启动:seed=3423 260602-08:47:21 (UTC+8)260602-08:47:22 (UTC+8)
1340P5 Optuna trial 375 完成:val=88.21 test=87.27 MLP=83.51 GNN=88.17 gateSem=0.437 260602-08:47:20 (UTC+8)260602-08:47:21 (UTC+8)
1339P5 Optuna trial 375 启动:seed=3422 260602-08:45:30 (UTC+8)260602-08:45:32 (UTC+8)
1338P5 Optuna trial 374 完成:val=88.46 test=88.04 MLP=85.31 GNN=88.00 gateSem=0.449 260602-08:45:29 (UTC+8)260602-08:45:32 (UTC+8)
1337P5 Optuna trial 374 启动:seed=3421 260602-08:43:14 (UTC+8)260602-08:43:16 (UTC+8)
1336P5 Optuna trial 373 完成:val=88.33 test=87.18 MLP=84.71 GNN=87.87 gateSem=0.456 260602-08:43:14 (UTC+8)260602-08:43:14 (UTC+8)
1335P5 Optuna trial 373 启动:seed=3420 260602-08:41:26 (UTC+8)260602-08:41:27 (UTC+8)
1334P5 Optuna trial 372 完成:val=88.50 test=87.74 MLP=84.96 GNN=88.04 gateSem=0.450 260602-08:41:25 (UTC+8)260602-08:41:26 (UTC+8)
1333P5 Optuna trial 372 启动:seed=3419 260602-08:40:28 (UTC+8)260602-08:40:30 (UTC+8)
1332P5 Optuna trial 371 完成:val=88.63 test=87.31 MLP=84.37 GNN=88.17 gateSem=0.426 260602-08:40:27 (UTC+8)260602-08:40:29 (UTC+8)
1331P5 Optuna trial 371 启动:seed=3418 260602-08:39:01 (UTC+8)260602-08:39:01 (UTC+8)
1330P5 Optuna trial 370 完成:val=88.38 test=87.87 MLP=84.24 GNN=88.17 gateSem=0.430 260602-08:39:00 (UTC+8)260602-08:39:00 (UTC+8)
1329P5 Optuna trial 370 启动:seed=3417 260602-08:37:41 (UTC+8)260602-08:37:42 (UTC+8)
1328P5 Optuna trial 369 完成:val=88.50 test=87.87 MLP=85.82 GNN=87.91 gateSem=0.418 260602-08:37:39 (UTC+8)260602-08:37:41 (UTC+8)
1327P5 Optuna trial 369 启动:seed=3416 260602-08:36:23 (UTC+8)260602-08:36:25 (UTC+8)
1326P5 Optuna trial 368 完成:val=88.63 test=88.00 MLP=85.65 GNN=87.83 gateSem=0.451 260602-08:36:22 (UTC+8)260602-08:36:23 (UTC+8)
1325P5 Optuna trial 367 完成:val=88.12 test=87.57 MLP=83.47 GNN=88.30 gateSem=0.450 260602-08:34:52 (UTC+8)260602-08:34:54 (UTC+8)
1324P5 Optuna trial 367 启动:seed=3414 260602-08:32:36 (UTC+8)260602-08:32:37 (UTC+8)
1323P5 Optuna trial 366 完成:val=88.46 test=87.74 MLP=84.75 GNN=87.83 gateSem=0.448 260602-08:32:34 (UTC+8)260602-08:32:35 (UTC+8)
1322P5 Optuna trial 365 完成:val=88.38 test=88.08 MLP=85.39 GNN=87.74 gateSem=0.454 260602-08:31:09 (UTC+8)260602-08:31:11 (UTC+8)
1321P5 Optuna trial 365 启动:seed=3412 260602-08:29:48 (UTC+8)260602-08:29:49 (UTC+8)
1320P5 Optuna trial 364 完成:val=88.42 test=86.89 MLP=84.28 GNN=87.87 gateSem=0.418 260602-08:29:47 (UTC+8)260602-08:29:48 (UTC+8)
1319P5 Optuna trial 363 完成:val=88.55 test=87.65 MLP=85.99 GNN=87.74 gateSem=0.427 260602-08:28:40 (UTC+8)260602-08:28:41 (UTC+8)
1318P5 Optuna trial 363 启动:seed=3410 260602-08:27:12 (UTC+8)260602-08:27:14 (UTC+8)
1317P5 Optuna trial 362 完成:val=88.68 test=87.74 MLP=85.48 GNN=87.83 gateSem=0.452 260602-08:27:11 (UTC+8)260602-08:27:13 (UTC+8)
1316P5 Optuna trial 362 启动:seed=3409 260602-08:25:48 (UTC+8)260602-08:25:50 (UTC+8)
1315P5 Optuna trial 361 完成:val=88.21 test=88.00 MLP=85.01 GNN=88.21 gateSem=0.420 260602-08:25:47 (UTC+8)260602-08:25:49 (UTC+8)
1314P5 Optuna trial 361 启动:seed=3408 260602-08:24:58 (UTC+8)260602-08:25:00 (UTC+8)
1313P5 Optuna trial 360 完成:val=88.38 test=87.57 MLP=85.18 GNN=88.17 gateSem=0.458 260602-08:24:57 (UTC+8)260602-08:24:58 (UTC+8)
1312P5 Optuna trial 360 启动:seed=3407 260602-08:22:57 (UTC+8)260602-08:22:58 (UTC+8)
1311P5 Optuna trial 359 完成:val=88.38 test=87.18 MLP=83.64 GNN=87.57 gateSem=0.424 260602-08:22:56 (UTC+8)260602-08:22:57 (UTC+8)
1310P5 Optuna trial 359 启动:seed=3406 260602-08:21:06 (UTC+8)260602-08:21:07 (UTC+8)
1309P5 Optuna trial 358 启动:seed=3405 260602-08:18:18 (UTC+8)260602-08:18:20 (UTC+8)
1308P5 Optuna trial 357 启动:seed=3404 260602-08:16:26 (UTC+8)260602-08:16:27 (UTC+8)
1307P5 Optuna trial 356 完成:val=87.82 test=87.36 MLP=84.62 GNN=88.30 gateSem=0.429 260602-08:16:25 (UTC+8)260602-08:16:26 (UTC+8)
1306P5 Optuna trial 355 完成:val=88.33 test=87.53 MLP=84.84 GNN=87.87 gateSem=0.403 260602-08:15:46 (UTC+8)260602-08:15:46 (UTC+8)
1305P5 Optuna trial 355 启动:seed=3402 260602-08:12:47 (UTC+8)260602-08:12:48 (UTC+8)
1304P5 Optuna trial 354 完成:val=88.38 test=87.83 MLP=84.15 GNN=88.17 gateSem=0.419 260602-08:12:46 (UTC+8)260602-08:12:47 (UTC+8)
1303P5 Optuna trial 354 启动:seed=3401 260602-08:10:03 (UTC+8)260602-08:10:04 (UTC+8)
1302P5 Optuna trial 353 完成:val=88.29 test=87.74 MLP=84.24 GNN=88.08 gateSem=0.406 260602-08:10:00 (UTC+8)260602-08:10:02 (UTC+8)
1301P5 Optuna trial 353 启动:seed=3400 260602-08:06:58 (UTC+8)260602-08:06:59 (UTC+8)
1300P5 Optuna trial 352 完成:val=88.42 test=87.65 MLP=84.79 GNN=87.95 gateSem=0.417 260602-08:06:57 (UTC+8)260602-08:06:58 (UTC+8)
1299P5 Optuna trial 352 启动:seed=3399 260602-08:05:36 (UTC+8)260602-08:05:37 (UTC+8)
1298P5 Optuna trial 351 完成:val=88.38 test=87.70 MLP=84.11 GNN=88.47 gateSem=0.428 260602-08:05:35 (UTC+8)260602-08:05:36 (UTC+8)
1297P5 Optuna trial 351 启动:seed=3398 260602-08:03:22 (UTC+8)260602-08:03:23 (UTC+8)
1296P5 Optuna trial 350 完成:val=88.68 test=87.57 MLP=84.75 GNN=88.12 gateSem=0.408 260602-08:03:21 (UTC+8)260602-08:03:22 (UTC+8)
1295P5 Optuna trial 350 启动:seed=3397 260602-08:01:42 (UTC+8)260602-08:01:43 (UTC+8)
1294P5 Optuna trial 349 完成:val=88.21 test=87.57 MLP=85.39 GNN=87.70 gateSem=0.455 260602-08:01:41 (UTC+8)260602-08:01:42 (UTC+8)
1293P5 Optuna trial 349 启动:seed=3396 260602-07:59:52 (UTC+8)260602-07:59:53 (UTC+8)
1292P5 Optuna trial 348 完成:val=85.04 test=85.01 MLP=81.25 GNN=85.56 gateSem=0.474 260602-07:59:51 (UTC+8)260602-07:59:52 (UTC+8)
1291P5 Optuna trial 348 启动:seed=3395 260602-07:59:26 (UTC+8)260602-07:59:27 (UTC+8)
1290P5 Optuna trial 347 完成:val=88.03 test=86.76 MLP=83.13 GNN=87.48 gateSem=0.462 260602-07:59:24 (UTC+8)260602-07:59:26 (UTC+8)
1289P5 Optuna trial 347 启动:seed=3394 260602-07:58:03 (UTC+8)260602-07:58:04 (UTC+8)
1288P5 Optuna trial 346 完成:val=88.25 test=87.23 MLP=84.02 GNN=87.87 gateSem=0.447 260602-07:58:02 (UTC+8)260602-07:58:03 (UTC+8)
1287P5 Optuna trial 346 启动:seed=3393 260602-07:56:57 (UTC+8)260602-07:56:59 (UTC+8)
1286P5 Optuna trial 345 完成:val=88.59 test=88.17 MLP=84.58 GNN=88.12 gateSem=0.428 260602-07:56:56 (UTC+8)260602-07:56:59 (UTC+8)
1285P5 Optuna trial 345 启动:seed=3392 260602-07:55:24 (UTC+8)260602-07:55:25 (UTC+8)
1284P5 Optuna trial 344 完成:val=88.21 test=87.70 MLP=84.54 GNN=87.91 gateSem=0.440 260602-07:55:23 (UTC+8)260602-07:55:24 (UTC+8)
1283P5 Optuna trial 344 启动:seed=3391 260602-07:53:57 (UTC+8)260602-07:53:58 (UTC+8)
1282P5 Optuna trial 343 完成:val=88.42 test=87.83 MLP=85.90 GNN=88.00 gateSem=0.453 260602-07:53:55 (UTC+8)260602-07:53:56 (UTC+8)
1281P5 Optuna trial 343 启动:seed=3390 260602-07:51:09 (UTC+8)260602-07:51:10 (UTC+8)
1280P5 Optuna trial 342 启动:seed=3389 260602-07:49:39 (UTC+8)260602-07:49:41 (UTC+8)
1279P5 Optuna trial 341 完成:val=88.12 test=87.01 MLP=84.37 GNN=87.48 gateSem=0.477 260602-07:49:38 (UTC+8)260602-07:49:40 (UTC+8)
1278P5 Optuna trial 341 启动:seed=3388 260602-07:48:01 (UTC+8)260602-07:48:03 (UTC+8)
1277P5 Optuna trial 340 完成:val=88.33 test=88.00 MLP=85.78 GNN=87.95 gateSem=0.443 260602-07:48:00 (UTC+8)260602-07:48:02 (UTC+8)
1276P5 Optuna trial 339 启动:seed=3386 260602-07:43:09 (UTC+8)260602-07:43:11 (UTC+8)
1275P5 Optuna trial 338 完成:val=88.76 test=87.70 MLP=85.65 GNN=87.83 gateSem=0.448 260602-07:43:08 (UTC+8)260602-07:43:09 (UTC+8)
1274P5 Optuna trial 338 启动:seed=3385 260602-07:39:51 (UTC+8)260602-07:39:52 (UTC+8)
1273P5 Optuna trial 337 完成:val=88.46 test=87.74 MLP=84.02 GNN=87.83 gateSem=0.421 260602-07:39:50 (UTC+8)260602-07:39:51 (UTC+8)
1272P5 Optuna trial 337 启动:seed=3384 260602-07:38:24 (UTC+8)260602-07:38:25 (UTC+8)
1271P5 Optuna trial 336 完成:val=88.25 test=87.48 MLP=83.98 GNN=88.04 gateSem=0.457 260602-07:38:23 (UTC+8)260602-07:38:24 (UTC+8)
1270P5 Optuna trial 336 启动:seed=3383 260602-07:36:55 (UTC+8)260602-07:36:56 (UTC+8)
1269P5 Optuna trial 335 完成:val=88.55 test=87.78 MLP=85.09 GNN=88.12 gateSem=0.439 260602-07:36:54 (UTC+8)260602-07:36:55 (UTC+8)
1268P5 Optuna trial 335 启动:seed=3382 260602-07:35:48 (UTC+8)260602-07:35:49 (UTC+8)
1267P5 Optuna trial 334 完成:val=88.46 test=87.31 MLP=83.85 GNN=88.17 gateSem=0.475 260602-07:35:47 (UTC+8)260602-07:35:48 (UTC+8)
1266P5 Optuna trial 334 启动:seed=3381 260602-07:33:02 (UTC+8)260602-07:33:03 (UTC+8)
1265P5 Optuna trial 333 启动:seed=3380 260602-07:31:17 (UTC+8)260602-07:31:17 (UTC+8)
1264P5 Optuna trial 332 完成:val=88.38 test=88.04 MLP=85.18 GNN=88.30 gateSem=0.438 260602-07:31:16 (UTC+8)260602-07:31:16 (UTC+8)
1263P5 Optuna trial 332 启动:seed=3379 260602-07:30:29 (UTC+8)260602-07:30:30 (UTC+8)
1262P5 Optuna trial 331 完成:val=88.42 test=87.87 MLP=83.51 GNN=87.95 gateSem=0.426 260602-07:30:28 (UTC+8)260602-07:30:29 (UTC+8)
1261P5 Optuna trial 331 启动:seed=3378 260602-07:28:29 (UTC+8)260602-07:28:30 (UTC+8)
1260P5 Optuna trial 330 完成:val=88.29 test=87.57 MLP=84.28 GNN=88.00 gateSem=0.445 260602-07:28:28 (UTC+8)260602-07:28:29 (UTC+8)
1259P5 Optuna trial 330 启动:seed=3377 260602-07:27:07 (UTC+8)260602-07:27:08 (UTC+8)
1258P5 Optuna trial 329 完成:val=88.38 test=87.65 MLP=85.78 GNN=87.78 gateSem=0.453 260602-07:27:06 (UTC+8)260602-07:27:07 (UTC+8)
1257P5 Optuna trial 329 启动:seed=3376 260602-07:26:08 (UTC+8)260602-07:26:09 (UTC+8)
1256P5 Optuna trial 328 完成:val=88.63 test=87.83 MLP=86.07 GNN=87.78 gateSem=0.445 260602-07:26:07 (UTC+8)260602-07:26:08 (UTC+8)
1255P5 Optuna trial 328 启动:seed=3375 260602-07:23:21 (UTC+8)260602-07:23:22 (UTC+8)
1254P5 Optuna trial 327 完成:val=88.63 test=87.57 MLP=85.60 GNN=87.78 gateSem=0.450 260602-07:23:20 (UTC+8)260602-07:23:20 (UTC+8)
1253P5 Optuna trial 327 启动:seed=3374 260602-07:20:43 (UTC+8)260602-07:20:44 (UTC+8)
1252P5 Optuna trial 326 完成:val=88.72 test=87.95 MLP=85.86 GNN=88.08 gateSem=0.447 260602-07:20:42 (UTC+8)260602-07:20:43 (UTC+8)
1251P5 Optuna trial 326 启动:seed=3373 260602-07:17:18 (UTC+8)260602-07:17:20 (UTC+8)
1250P5 Optuna trial 325 完成:val=88.63 test=87.70 MLP=84.96 GNN=87.78 gateSem=0.430 260602-07:17:17 (UTC+8)260602-07:17:18 (UTC+8)
1249P5 Optuna trial 325 启动:seed=3372 260602-07:16:02 (UTC+8)260602-07:16:03 (UTC+8)
1248P5 Optuna trial 324 完成:val=88.42 test=87.65 MLP=84.96 GNN=88.38 gateSem=0.426 260602-07:16:01 (UTC+8)260602-07:16:02 (UTC+8)
1247P5 Optuna trial 324 启动:seed=3371 260602-07:15:13 (UTC+8)260602-07:15:14 (UTC+8)
1246P5 Optuna trial 323 完成:val=88.16 test=87.36 MLP=84.54 GNN=87.40 gateSem=0.515 260602-07:15:11 (UTC+8)260602-07:15:13 (UTC+8)
1245P5 Optuna trial 323 启动:seed=3370 260602-07:14:06 (UTC+8)260602-07:14:08 (UTC+8)
1244P5 Optuna trial 322 完成:val=88.80 test=87.95 MLP=84.37 GNN=87.87 gateSem=0.433 260602-07:14:05 (UTC+8)260602-07:14:07 (UTC+8)
1243P5 Optuna trial 322 启动:seed=3369 260602-07:12:26 (UTC+8)260602-07:12:27 (UTC+8)
1242P5 Optuna trial 321 完成:val=88.50 test=87.87 MLP=85.99 GNN=87.83 gateSem=0.450 260602-07:12:25 (UTC+8)260602-07:12:26 (UTC+8)
1241P5 Optuna trial 321 启动:seed=3368 260602-07:09:35 (UTC+8)260602-07:09:36 (UTC+8)
1240P5 Optuna trial 320 完成:val=88.21 test=87.18 MLP=84.37 GNN=88.00 gateSem=0.463 260602-07:09:34 (UTC+8)260602-07:09:35 (UTC+8)
1239P5 Optuna trial 320 启动:seed=3367 260602-07:08:39 (UTC+8)260602-07:08:41 (UTC+8)
1238P5 Optuna trial 319 完成:val=88.55 test=87.53 MLP=84.45 GNN=87.83 gateSem=0.440 260602-07:08:38 (UTC+8)260602-07:08:39 (UTC+8)
1237P5 Optuna trial 318 完成:val=88.12 test=87.65 MLP=83.34 GNN=88.38 gateSem=0.411 260602-07:06:53 (UTC+8)260602-07:06:55 (UTC+8)
1236P5 Optuna trial 318 启动:seed=3365 260602-07:05:12 (UTC+8)260602-07:05:14 (UTC+8)
1235P5 Optuna trial 317 完成:val=88.16 test=87.61 MLP=86.33 GNN=87.78 gateSem=0.455 260602-07:05:11 (UTC+8)260602-07:05:12 (UTC+8)
1234P5 Optuna trial 317 启动:seed=3364 260602-07:02:40 (UTC+8)260602-07:02:43 (UTC+8)
1233P5 Optuna trial 316 完成:val=88.12 test=87.74 MLP=86.20 GNN=87.61 gateSem=0.466 260602-07:02:39 (UTC+8)260602-07:02:42 (UTC+8)
1232P5 Optuna trial 316 启动:seed=3363 260602-07:01:35 (UTC+8)260602-07:01:37 (UTC+8)
1231P5 Optuna trial 315 启动:seed=3362 260602-06:59:03 (UTC+8)260602-06:59:05 (UTC+8)
1230P5 Optuna trial 314 完成:val=88.50 test=87.57 MLP=85.13 GNN=87.74 gateSem=0.465 260602-06:59:01 (UTC+8)260602-06:59:04 (UTC+8)
1229P5 Optuna trial 314 启动:seed=3361 260602-06:56:30 (UTC+8)260602-06:56:36 (UTC+8)
1228P5 Optuna trial 313 完成:val=88.42 test=87.87 MLP=84.75 GNN=88.21 gateSem=0.426 260602-06:56:29 (UTC+8)260602-06:56:34 (UTC+8)
1227P5 Optuna trial 313 启动:seed=3360 260602-06:55:05 (UTC+8)260602-06:55:07 (UTC+8)
1226P5 Optuna trial 312 完成:val=88.50 test=87.87 MLP=85.35 GNN=87.78 gateSem=0.444 260602-06:55:04 (UTC+8)260602-06:55:05 (UTC+8)
1225P5 Optuna trial 312 启动:seed=3359 260602-06:52:19 (UTC+8)260602-06:52:21 (UTC+8)
1224P5 Optuna trial 311 完成:val=88.33 test=87.57 MLP=84.66 GNN=88.12 gateSem=0.467 260602-06:52:18 (UTC+8)260602-06:52:20 (UTC+8)
1223P5 Optuna trial 311 启动:seed=3358 260602-06:51:23 (UTC+8)260602-06:51:24 (UTC+8)
1222P5 Optuna trial 310 完成:val=88.29 test=87.91 MLP=84.62 GNN=87.95 gateSem=0.418 260602-06:51:22 (UTC+8)260602-06:51:23 (UTC+8)
1221P5 Optuna trial 310 启动:seed=3357 260602-06:49:16 (UTC+8)260602-06:49:18 (UTC+8)
1220P5 Optuna trial 309 完成:val=88.50 test=88.00 MLP=85.05 GNN=87.91 gateSem=0.431 260602-06:49:15 (UTC+8)260602-06:49:17 (UTC+8)
1219P5 Optuna trial 308 完成:val=88.68 test=87.87 MLP=85.31 GNN=87.95 gateSem=0.423 260602-06:46:54 (UTC+8)260602-06:46:55 (UTC+8)
1218P5 Optuna trial 308 启动:seed=3355 260602-06:44:15 (UTC+8)260602-06:44:16 (UTC+8)
1217P5 Optuna trial 307 启动:seed=3354 260602-06:42:58 (UTC+8)260602-06:43:00 (UTC+8)
1216P5 Optuna trial 306 启动:seed=3353 260602-06:42:02 (UTC+8)260602-06:42:06 (UTC+8)
1215P5 Optuna trial 305 完成:val=88.21 test=87.14 MLP=83.68 GNN=87.87 gateSem=0.446 260602-06:42:01 (UTC+8)260602-06:42:05 (UTC+8)
1214P5 Optuna trial 305 启动:seed=3352 260602-06:40:02 (UTC+8)260602-06:40:03 (UTC+8)
1213P5 Optuna trial 304 完成:val=88.38 test=87.14 MLP=84.28 GNN=87.91 gateSem=0.426 260602-06:40:01 (UTC+8)260602-06:40:02 (UTC+8)
1212P5 Optuna trial 304 启动:seed=3351 260602-06:39:37 (UTC+8)260602-06:39:38 (UTC+8)
1211P5 Optuna trial 303 完成:val=88.50 test=87.74 MLP=84.58 GNN=88.00 gateSem=0.429 260602-06:39:36 (UTC+8)260602-06:39:37 (UTC+8)
1210P5 Optuna trial 303 启动:seed=3350 260602-06:37:11 (UTC+8)260602-06:37:12 (UTC+8)
1209P5 Optuna trial 302 启动:seed=3349 260602-06:36:17 (UTC+8)260602-06:36:19 (UTC+8)
1208P5 Optuna trial 301 启动:seed=3348 260602-06:33:42 (UTC+8)260602-06:33:44 (UTC+8)
1207P5 Optuna trial 300 完成:val=88.55 test=87.95 MLP=84.88 GNN=88.08 gateSem=0.435 260602-06:33:41 (UTC+8)260602-06:33:43 (UTC+8)
1206P5 Optuna trial 300 启动:seed=3347 260602-06:31:48 (UTC+8)260602-06:31:49 (UTC+8)
1205P5 Optuna trial 299 完成:val=88.63 test=87.87 MLP=85.31 GNN=87.78 gateSem=0.458 260602-06:31:48 (UTC+8)260602-06:31:48 (UTC+8)
1204P5 Optuna trial 298 完成:val=88.29 test=87.06 MLP=84.02 GNN=87.65 gateSem=0.468 260602-06:28:54 (UTC+8)260602-06:28:56 (UTC+8)
1203P5 Optuna trial 298 启动:seed=3345 260602-06:27:29 (UTC+8)260602-06:27:32 (UTC+8)
1202P5 Optuna trial 297 完成:val=88.50 test=87.40 MLP=83.30 GNN=87.91 gateSem=0.402 260602-06:27:28 (UTC+8)260602-06:27:31 (UTC+8)
1201P5 Optuna trial 297 启动:seed=3344 260602-06:26:35 (UTC+8)260602-06:26:36 (UTC+8)
1200P5 Optuna trial 296 完成:val=88.16 test=87.14 MLP=84.75 GNN=87.65 gateSem=0.466 260602-06:26:34 (UTC+8)260602-06:26:35 (UTC+8)
1199P5 Optuna trial 296 启动:seed=3343 260602-06:25:06 (UTC+8)260602-06:25:08 (UTC+8)
1198P5 Optuna trial 295 完成:val=88.29 test=87.06 MLP=83.81 GNN=87.53 gateSem=0.454 260602-06:25:05 (UTC+8)260602-06:25:06 (UTC+8)
1197P5 Optuna trial 295 启动:seed=3342 260602-06:23:40 (UTC+8)260602-06:23:42 (UTC+8)
1196P5 Optuna trial 294 完成:val=88.38 test=87.65 MLP=85.13 GNN=88.00 gateSem=0.466 260602-06:23:39 (UTC+8)260602-06:23:41 (UTC+8)
1195P5 Optuna trial 294 启动:seed=3341 260602-06:21:39 (UTC+8)260602-06:21:40 (UTC+8)
1194P5 Optuna trial 293 完成:val=88.12 test=87.31 MLP=84.71 GNN=88.08 gateSem=0.457 260602-06:21:38 (UTC+8)260602-06:21:39 (UTC+8)
1193P5 Optuna trial 291 启动:seed=3338 260602-06:15:59 (UTC+8)260602-06:16:02 (UTC+8)
1192P5 Optuna trial 290 启动:seed=3337 260602-06:13:54 (UTC+8)260602-06:13:56 (UTC+8)
1191P5 Optuna trial 289 完成:val=88.25 test=87.44 MLP=84.02 GNN=88.00 gateSem=0.437 260602-06:13:53 (UTC+8)260602-06:13:54 (UTC+8)
1190P5 Optuna trial 289 启动:seed=3336 260602-06:12:41 (UTC+8)260602-06:12:43 (UTC+8)
1189P5 Optuna trial 288 完成:val=88.08 test=87.65 MLP=87.40 GNN=87.31 gateSem=0.485 260602-06:12:40 (UTC+8)260602-06:12:41 (UTC+8)
1188P5 Optuna trial 288 启动:seed=3335 260602-06:11:01 (UTC+8)260602-06:11:03 (UTC+8)
1187P5 Optuna trial 286 完成:val=88.59 test=87.70 MLP=84.88 GNN=88.21 gateSem=0.447 260602-06:06:54 (UTC+8)260602-06:06:55 (UTC+8)
1186P5 Optuna trial 286 启动:seed=3333 260602-06:05:55 (UTC+8)260602-06:05:57 (UTC+8)
1185P5 Optuna trial 285 完成:val=88.33 test=87.31 MLP=83.81 GNN=87.83 gateSem=0.434 260602-06:05:53 (UTC+8)260602-06:05:55 (UTC+8)
1184P5 Optuna trial 285 启动:seed=3332 260602-06:04:30 (UTC+8)260602-06:04:31 (UTC+8)
1183P5 Optuna trial 284 完成:val=88.38 test=87.91 MLP=85.69 GNN=87.91 gateSem=0.470 260602-06:04:29 (UTC+8)260602-06:04:30 (UTC+8)
1182P5 Optuna trial 284 启动:seed=3331 260602-06:02:13 (UTC+8)260602-06:02:14 (UTC+8)
1181P5 Optuna trial 283 完成:val=84.79 test=84.62 MLP=80.91 GNN=85.69 gateSem=0.485 260602-06:02:12 (UTC+8)260602-06:02:12 (UTC+8)
1180P5 Optuna trial 283 启动:seed=3330 260602-06:01:24 (UTC+8)260602-06:01:25 (UTC+8)
1179P5 Optuna trial 282 完成:val=88.50 test=87.65 MLP=84.66 GNN=87.57 gateSem=0.434 260602-06:01:23 (UTC+8)260602-06:01:24 (UTC+8)
1178P5 Optuna trial 281 完成:val=88.42 test=87.27 MLP=84.66 GNN=87.65 gateSem=0.471 260602-05:59:41 (UTC+8)260602-05:59:44 (UTC+8)
1177P5 Optuna trial 281 启动:seed=3328 260602-05:58:47 (UTC+8)260602-05:58:49 (UTC+8)
1176P5 Optuna trial 280 完成:val=88.16 test=87.44 MLP=84.54 GNN=88.21 gateSem=0.442 260602-05:58:46 (UTC+8)260602-05:58:48 (UTC+8)
1175P5 Optuna trial 280 启动:seed=3327 260602-05:57:40 (UTC+8)260602-05:57:41 (UTC+8)
1174P5 Optuna trial 279 完成:val=88.42 test=87.61 MLP=85.18 GNN=87.87 gateSem=0.424 260602-05:57:39 (UTC+8)260602-05:57:40 (UTC+8)
1173P5 Optuna trial 279 启动:seed=3326 260602-05:55:26 (UTC+8)260602-05:55:27 (UTC+8)
1172P5 Optuna trial 278 完成:val=88.33 test=87.70 MLP=86.33 GNN=87.83 gateSem=0.463 260602-05:55:25 (UTC+8)260602-05:55:26 (UTC+8)
1171P5 Optuna trial 278 启动:seed=3325 260602-05:54:02 (UTC+8)260602-05:54:03 (UTC+8)
1170P5 Optuna trial 277 完成:val=88.25 test=87.40 MLP=83.90 GNN=88.12 gateSem=0.450 260602-05:54:01 (UTC+8)260602-05:54:02 (UTC+8)
1169P5 Optuna trial 277 启动:seed=3324 260602-05:52:49 (UTC+8)260602-05:52:51 (UTC+8)
1168P5 Optuna trial 276 完成:val=88.46 test=87.95 MLP=85.31 GNN=88.00 gateSem=0.426 260602-05:52:48 (UTC+8)260602-05:52:50 (UTC+8)
1167P5 Optuna trial 276 启动:seed=3323 260602-05:51:27 (UTC+8)260602-05:51:28 (UTC+8)
1166P5 Optuna trial 275 完成:val=88.63 test=87.87 MLP=85.52 GNN=87.78 gateSem=0.426 260602-05:51:26 (UTC+8)260602-05:51:27 (UTC+8)
1165P5 Optuna trial 275 启动:seed=3322 260602-05:50:00 (UTC+8)260602-05:50:02 (UTC+8)
1164P5 Optuna trial 274 完成:val=88.50 test=87.78 MLP=84.88 GNN=88.00 gateSem=0.420 260602-05:49:59 (UTC+8)260602-05:50:01 (UTC+8)
1163P5 Optuna trial 274 启动:seed=3321 260602-05:48:49 (UTC+8)260602-05:48:51 (UTC+8)
1162P5 Optuna trial 273 完成:val=87.91 test=86.97 MLP=83.34 GNN=88.04 gateSem=0.438 260602-05:48:48 (UTC+8)260602-05:48:49 (UTC+8)
1161P5 Optuna trial 273 启动:seed=3320 260602-05:47:02 (UTC+8)260602-05:47:03 (UTC+8)
1160P5 Optuna trial 272 启动:seed=3319 260602-05:45:34 (UTC+8)260602-05:45:36 (UTC+8)
1159P5 Optuna trial 271 完成:val=88.50 test=87.95 MLP=84.07 GNN=88.04 gateSem=0.415 260602-05:45:33 (UTC+8)260602-05:45:34 (UTC+8)
1158P5 Optuna trial 270 完成:val=88.29 test=86.93 MLP=83.38 GNN=88.08 gateSem=0.464 260602-05:43:42 (UTC+8)260602-05:43:43 (UTC+8)
1157P5 Optuna trial 270 启动:seed=3317 260602-05:42:08 (UTC+8)260602-05:42:10 (UTC+8)
1156P5 Optuna trial 269 完成:val=88.21 test=87.44 MLP=83.60 GNN=87.83 gateSem=0.436 260602-05:42:07 (UTC+8)260602-05:42:09 (UTC+8)
1155P5 Optuna trial 269 启动:seed=3316 260602-05:39:38 (UTC+8)260602-05:39:40 (UTC+8)
1154P5 Optuna trial 268 完成:val=88.46 test=87.70 MLP=84.49 GNN=88.30 gateSem=0.414 260602-05:39:37 (UTC+8)260602-05:39:39 (UTC+8)
1153P5 Optuna trial 268 启动:seed=3315 260602-05:37:48 (UTC+8)260602-05:37:49 (UTC+8)
1152P5 Optuna trial 267 完成:val=88.46 test=87.74 MLP=86.03 GNN=88.00 gateSem=0.430 260602-05:37:47 (UTC+8)260602-05:37:48 (UTC+8)
1151P5 Optuna trial 266 启动:seed=3313 260602-05:34:01 (UTC+8)260602-05:34:01 (UTC+8)
1150P5 Optuna trial 265 完成:val=87.99 test=86.93 MLP=83.04 GNN=88.00 gateSem=0.448 260602-05:33:59 (UTC+8)260602-05:34:00 (UTC+8)
1149P5 Optuna trial 264 完成:val=88.63 test=88.00 MLP=85.73 GNN=87.91 gateSem=0.440 260602-05:32:12 (UTC+8)260602-05:32:13 (UTC+8)
1148P5 Optuna trial 263 完成:val=88.59 test=88.08 MLP=85.35 GNN=87.87 gateSem=0.453 260602-05:29:34 (UTC+8)260602-05:29:34 (UTC+8)
1147P5 Optuna trial 262 完成:val=88.25 test=87.61 MLP=87.10 GNN=86.89 gateSem=0.463 260602-05:26:45 (UTC+8)260602-05:26:46 (UTC+8)
1146P5 Optuna trial 262 启动:seed=3309 260602-05:25:40 (UTC+8)260602-05:25:41 (UTC+8)
1145P5 Optuna trial 261 完成:val=88.16 test=87.44 MLP=83.98 GNN=88.08 gateSem=0.472 260602-05:25:38 (UTC+8)260602-05:25:40 (UTC+8)
1144P5 Optuna trial 261 启动:seed=3308 260602-05:23:50 (UTC+8)260602-05:23:50 (UTC+8)
1143P5 Optuna trial 260 完成:val=88.21 test=87.01 MLP=83.90 GNN=87.83 gateSem=0.469 260602-05:23:49 (UTC+8)260602-05:23:49 (UTC+8)
1142P5 Optuna trial 259 完成:val=88.46 test=87.83 MLP=86.25 GNN=87.83 gateSem=0.430 260602-05:21:58 (UTC+8)260602-05:21:59 (UTC+8)
1141P5 Optuna trial 259 启动:seed=3306 260602-05:20:47 (UTC+8)260602-05:20:49 (UTC+8)
1140P5 Optuna trial 258 完成:val=88.29 test=87.44 MLP=84.19 GNN=88.21 gateSem=0.460 260602-05:20:46 (UTC+8)260602-05:20:47 (UTC+8)
1139P5 Optuna trial 258 启动:seed=3305 260602-05:19:23 (UTC+8)260602-05:19:25 (UTC+8)
1138P5 Optuna trial 257 完成:val=88.59 test=87.57 MLP=85.99 GNN=87.70 gateSem=0.446 260602-05:19:22 (UTC+8)260602-05:19:24 (UTC+8)
1137P5 Optuna trial 257 启动:seed=3304 260602-05:17:36 (UTC+8)260602-05:17:36 (UTC+8)
1136P5 Optuna trial 256 完成:val=88.03 test=87.36 MLP=83.90 GNN=88.00 gateSem=0.430 260602-05:17:35 (UTC+8)260602-05:17:35 (UTC+8)
1135P5 Optuna trial 256 启动:seed=3303 260602-05:16:36 (UTC+8)260602-05:16:37 (UTC+8)
1134P5 Optuna trial 255 完成:val=88.33 test=87.44 MLP=84.54 GNN=87.91 gateSem=0.431 260602-05:16:35 (UTC+8)260602-05:16:36 (UTC+8)
1133P5 Optuna trial 255 启动:seed=3302 260602-05:15:03 (UTC+8)260602-05:15:03 (UTC+8)
1132P5 Optuna trial 254 完成:val=88.59 test=87.57 MLP=85.31 GNN=88.04 gateSem=0.456 260602-05:15:02 (UTC+8)260602-05:15:02 (UTC+8)
1131P5 Optuna trial 254 启动:seed=3301 260602-05:13:32 (UTC+8)260602-05:13:33 (UTC+8)
1130P5 Optuna trial 253 完成:val=88.38 test=87.14 MLP=84.11 GNN=87.83 gateSem=0.492 260602-05:13:31 (UTC+8)260602-05:13:32 (UTC+8)
1129P5 Optuna trial 253 启动:seed=3300 260602-05:11:52 (UTC+8)260602-05:11:53 (UTC+8)
1128P5 Optuna trial 252 完成:val=88.38 test=87.78 MLP=84.28 GNN=87.95 gateSem=0.414 260602-05:11:50 (UTC+8)260602-05:11:52 (UTC+8)
1127P5 Optuna trial 252 启动:seed=3299 260602-05:10:39 (UTC+8)260602-05:10:40 (UTC+8)
1126P5 Optuna trial 251 完成:val=88.29 test=87.74 MLP=86.76 GNN=87.70 gateSem=0.475 260602-05:10:38 (UTC+8)260602-05:10:39 (UTC+8)
1125P5 Optuna trial 251 启动:seed=3298 260602-05:09:31 (UTC+8)260602-05:09:32 (UTC+8)
1124P5 Optuna trial 250 完成:val=88.72 test=87.65 MLP=85.78 GNN=87.61 gateSem=0.465 260602-05:09:30 (UTC+8)260602-05:09:31 (UTC+8)
1123P5 Optuna trial 250 启动:seed=3297 260602-05:07:43 (UTC+8)260602-05:07:44 (UTC+8)
1122P5 Optuna trial 248 完成:val=88.50 test=87.48 MLP=85.35 GNN=87.87 gateSem=0.460 260602-05:06:01 (UTC+8)260602-05:06:02 (UTC+8)
1121P5 Optuna trial 248 启动:seed=3295 260602-05:04:32 (UTC+8)260602-05:04:33 (UTC+8)
1120P5 Optuna trial 247 完成:val=88.55 test=87.65 MLP=84.92 GNN=87.91 gateSem=0.456 260602-05:04:31 (UTC+8)260602-05:04:32 (UTC+8)
1119P5 Optuna trial 247 启动:seed=3294 260602-05:01:52 (UTC+8)260602-05:01:54 (UTC+8)
1118P5 Optuna trial 246 完成:val=88.55 test=87.70 MLP=85.78 GNN=87.57 gateSem=0.454 260602-05:01:51 (UTC+8)260602-05:01:53 (UTC+8)
1117P5 Optuna trial 246 启动:seed=3293 260602-05:00:12 (UTC+8)260602-05:00:13 (UTC+8)
1116P5 Optuna trial 245 启动:seed=3292 260602-04:58:31 (UTC+8)260602-04:58:32 (UTC+8)
1115P5 Optuna trial 244 完成:val=88.55 test=87.61 MLP=85.60 GNN=87.61 gateSem=0.462 260602-04:58:30 (UTC+8)260602-04:58:30 (UTC+8)
1114P5 Optuna trial 243 完成:val=88.63 test=87.78 MLP=85.31 GNN=87.78 gateSem=0.461 260602-04:56:53 (UTC+8)260602-04:56:54 (UTC+8)
1113P5 Optuna trial 243 启动:seed=3290 260602-04:55:30 (UTC+8)260602-04:55:31 (UTC+8)
1112P5 Optuna trial 242 完成:val=88.55 test=87.91 MLP=85.13 GNN=87.83 gateSem=0.461 260602-04:55:28 (UTC+8)260602-04:55:29 (UTC+8)
1111P5 Optuna trial 242 启动:seed=3289 260602-04:52:55 (UTC+8)260602-04:53:51 (UTC+8)
1110P5 Optuna trial 241 完成:val=88.29 test=87.53 MLP=84.37 GNN=88.08 gateSem=0.460 260602-04:52:54 (UTC+8)260602-04:53:50 (UTC+8)
1109P5 Optuna trial 241 启动:seed=3288 260602-04:51:46 (UTC+8)260602-04:52:39 (UTC+8)
1108P5 Optuna trial 240 完成:val=88.50 test=87.57 MLP=85.69 GNN=87.78 gateSem=0.451 260602-04:51:45 (UTC+8)260602-04:52:38 (UTC+8)
1107P5 Optuna trial 240 启动:seed=3287 260602-04:50:11 (UTC+8)260602-04:51:00 (UTC+8)
1106P5 Optuna trial 238 完成:val=88.68 test=87.91 MLP=85.13 GNN=87.74 gateSem=0.455 260602-04:48:26 (UTC+8)260602-04:49:11 (UTC+8)
1105P5 Optuna trial 237 完成:val=88.33 test=87.78 MLP=84.79 GNN=88.04 gateSem=0.441 260602-04:46:49 (UTC+8)260602-04:47:30 (UTC+8)
1104P5 Optuna trial 237 启动:seed=3284 260602-04:45:37 (UTC+8)260602-04:46:14 (UTC+8)
1103P5 Optuna trial 236 完成:val=88.68 test=87.78 MLP=85.86 GNN=87.65 gateSem=0.453 260602-04:45:36 (UTC+8)260602-04:46:13 (UTC+8)
1102P5 Optuna trial 236 启动:seed=3283 260602-04:44:04 (UTC+8)260602-04:44:38 (UTC+8)
1101P5 Optuna trial 235 完成:val=87.99 test=86.84 MLP=84.07 GNN=87.61 gateSem=0.451 260602-04:44:03 (UTC+8)260602-04:44:37 (UTC+8)
1100P5 Optuna trial 235 启动:seed=3282 260602-04:42:41 (UTC+8)260602-04:43:11 (UTC+8)
1099P5 Optuna trial 234 完成:val=88.68 test=87.95 MLP=85.99 GNN=87.91 gateSem=0.446 260602-04:42:40 (UTC+8)260602-04:43:10 (UTC+8)
1098P5 Optuna trial 234 启动:seed=3281 260602-04:40:12 (UTC+8)260602-04:40:35 (UTC+8)
1097P5 Optuna trial 233 完成:val=88.59 test=87.74 MLP=85.18 GNN=87.95 gateSem=0.467 260602-04:40:10 (UTC+8)260602-04:40:34 (UTC+8)
1096P5 Optuna trial 233 启动:seed=3280 260602-04:37:50 (UTC+8)260602-04:38:09 (UTC+8)
1095P5 Optuna trial 232 完成:val=88.38 test=87.78 MLP=85.43 GNN=88.04 gateSem=0.463 260602-04:37:50 (UTC+8)260602-04:38:07 (UTC+8)
1094P5 Optuna trial 232 启动:seed=3279 260602-04:36:01 (UTC+8)260602-04:36:15 (UTC+8)
1093P5 Optuna trial 231 完成:val=88.50 test=88.00 MLP=85.13 GNN=87.91 gateSem=0.437 260602-04:36:00 (UTC+8)260602-04:36:14 (UTC+8)
1092P5 Optuna trial 231 启动:seed=3278 260602-04:34:09 (UTC+8)260602-04:34:18 (UTC+8)
1091P5 Optuna trial 230 完成:val=88.55 test=87.87 MLP=84.41 GNN=88.25 gateSem=0.394 260602-04:34:08 (UTC+8)260602-04:34:16 (UTC+8)
1090P5 Optuna trial 230 启动:seed=3277 260602-04:32:51 (UTC+8)260602-04:32:56 (UTC+8)
1089P5 Optuna trial 229 完成:val=88.59 test=87.87 MLP=85.43 GNN=88.00 gateSem=0.418 260602-04:32:50 (UTC+8)260602-04:32:55 (UTC+8)
1088P5 Optuna trial 229 启动:seed=3276 260602-04:30:28 (UTC+8)260602-04:30:29 (UTC+8)
1087P5 Optuna trial 228 启动:seed=3275 260602-04:29:22 (UTC+8)260602-04:29:23 (UTC+8)
1086P5 Optuna trial 227 完成:val=88.46 test=87.40 MLP=84.58 GNN=88.04 gateSem=0.437 260602-04:29:20 (UTC+8)260602-04:29:22 (UTC+8)
1085P5 Optuna trial 227 启动:seed=3274 260602-04:26:31 (UTC+8)260602-04:27:29 (UTC+8)
1084P5 Optuna trial 226 完成:val=88.33 test=87.70 MLP=83.98 GNN=88.04 gateSem=0.431 260602-04:26:29 (UTC+8)260602-04:27:28 (UTC+8)
1083P5 Optuna trial 226 启动:seed=3273 260602-04:25:49 (UTC+8)260602-04:26:46 (UTC+8)
1082P5 Optuna trial 225 完成:val=88.46 test=88.04 MLP=85.31 GNN=87.74 gateSem=0.414 260602-04:25:48 (UTC+8)260602-04:26:45 (UTC+8)
1081P5 Optuna trial 225 启动:seed=3272 260602-04:22:58 (UTC+8)260602-04:23:47 (UTC+8)
1080P5 Optuna trial 224 完成:val=88.55 test=88.21 MLP=85.01 GNN=88.00 gateSem=0.420 260602-04:22:57 (UTC+8)260602-04:23:46 (UTC+8)
1079P5 Optuna trial 224 启动:seed=3271 260602-04:21:00 (UTC+8)260602-04:21:44 (UTC+8)
1078P5 Optuna trial 223 完成:val=88.33 test=87.48 MLP=85.05 GNN=87.78 gateSem=0.421 260602-04:20:59 (UTC+8)260602-04:21:43 (UTC+8)
1077P5 Optuna trial 223 启动:seed=3270 260602-04:19:29 (UTC+8)260602-04:20:10 (UTC+8)
1076P5 Optuna trial 222 完成:val=88.42 test=87.70 MLP=84.75 GNN=88.00 gateSem=0.412 260602-04:19:28 (UTC+8)260602-04:20:08 (UTC+8)
1075P5 Optuna trial 222 启动:seed=3269 260602-04:17:38 (UTC+8)260602-04:18:14 (UTC+8)
1074P5 Optuna trial 221 完成:val=88.38 test=87.95 MLP=85.73 GNN=87.87 gateSem=0.425 260602-04:17:37 (UTC+8)260602-04:18:13 (UTC+8)
1073P5 Optuna trial 221 启动:seed=3268 260602-04:15:14 (UTC+8)260602-04:15:44 (UTC+8)
1072P5 Optuna trial 220 完成:val=88.50 test=87.87 MLP=86.12 GNN=87.78 gateSem=0.429 260602-04:15:13 (UTC+8)260602-04:15:43 (UTC+8)
1071P5 Optuna trial 220 启动:seed=3267 260602-04:12:18 (UTC+8)260602-04:12:41 (UTC+8)
1070P5 Optuna trial 219 完成:val=88.03 test=87.53 MLP=83.51 GNN=88.47 gateSem=0.408 260602-04:12:17 (UTC+8)260602-04:12:40 (UTC+8)
1069P5 Optuna trial 219 启动:seed=3266 260602-04:08:56 (UTC+8)260602-04:09:10 (UTC+8)
1068P5 Optuna trial 218 完成:val=88.46 test=88.00 MLP=85.26 GNN=87.87 gateSem=0.421 260602-04:08:55 (UTC+8)260602-04:09:09 (UTC+8)
1067P5 Optuna trial 218 启动:seed=3265 260602-04:06:32 (UTC+8)260602-04:06:41 (UTC+8)
1066P5 Optuna trial 216 完成:val=88.21 test=87.27 MLP=83.64 GNN=87.78 gateSem=0.425 260602-04:05:07 (UTC+8)260602-04:05:11 (UTC+8)
1065P5 Optuna trial 216 启动:seed=3263 260602-04:03:33 (UTC+8)260602-04:03:34 (UTC+8)
1064P5 Optuna trial 215 完成:val=88.59 test=87.91 MLP=85.48 GNN=88.00 gateSem=0.430 260602-04:03:32 (UTC+8)260602-04:03:33 (UTC+8)
1063P5 Optuna trial 215 启动:seed=3262 260602-04:02:31 (UTC+8)260602-04:02:31 (UTC+8)
1062P5 Optuna trial 214 完成:val=88.55 test=88.21 MLP=85.69 GNN=87.78 gateSem=0.418 260602-04:02:30 (UTC+8)260602-04:02:30 (UTC+8)
1061P5 Optuna trial 214 启动:seed=3261 260602-04:00:14 (UTC+8)260602-04:00:15 (UTC+8)
1060P5 Optuna trial 213 完成:val=88.59 test=87.53 MLP=85.05 GNN=87.91 gateSem=0.401 260602-04:00:13 (UTC+8)260602-04:00:14 (UTC+8)
1059P5 Optuna trial 213 启动:seed=3260 260602-03:57:57 (UTC+8)260602-03:57:58 (UTC+8)
1058P5 Optuna trial 212 完成:val=88.50 test=88.12 MLP=85.35 GNN=87.57 gateSem=0.427 260602-03:57:56 (UTC+8)260602-03:57:57 (UTC+8)
1057P5 Optuna trial 212 启动:seed=3259 260602-03:55:49 (UTC+8)260602-03:55:50 (UTC+8)
1056P5 Optuna trial 211 完成:val=88.38 test=87.61 MLP=83.90 GNN=88.00 gateSem=0.403 260602-03:55:48 (UTC+8)260602-03:55:49 (UTC+8)
1055P5 Optuna trial 211 启动:seed=3258 260602-03:54:05 (UTC+8)260602-03:54:09 (UTC+8)
1054P5 Optuna trial 210 完成:val=88.38 test=87.74 MLP=84.58 GNN=88.17 gateSem=0.414 260602-03:54:04 (UTC+8)260602-03:54:08 (UTC+8)
1053P5 Optuna trial 210 启动:seed=3257 260602-03:53:03 (UTC+8)260602-03:53:05 (UTC+8)
1052P5 Optuna trial 209 完成:val=88.42 test=87.91 MLP=85.86 GNN=87.83 gateSem=0.402 260602-03:53:02 (UTC+8)260602-03:53:04 (UTC+8)
1051P5 Optuna trial 209 启动:seed=3256 260602-03:50:28 (UTC+8)260602-03:50:29 (UTC+8)
1050P5 Optuna trial 208 完成:val=88.46 test=87.74 MLP=84.54 GNN=88.30 gateSem=0.414 260602-03:50:26 (UTC+8)260602-03:50:28 (UTC+8)
1049P5 Optuna trial 208 启动:seed=3255 260602-03:48:52 (UTC+8)260602-03:48:54 (UTC+8)
1048P5 Optuna trial 207 完成:val=88.46 test=87.57 MLP=85.05 GNN=87.65 gateSem=0.408 260602-03:48:51 (UTC+8)260602-03:48:53 (UTC+8)
1047P5 Optuna trial 207 启动:seed=3254 260602-03:47:01 (UTC+8)260602-03:47:03 (UTC+8)
1046P5 Optuna trial 206 启动:seed=3253 260602-03:45:29 (UTC+8)260602-03:45:31 (UTC+8)
1045P5 Optuna trial 205 完成:val=88.29 test=87.10 MLP=83.81 GNN=88.00 gateSem=0.426 260602-03:45:28 (UTC+8)260602-03:45:30 (UTC+8)
1044P5 Optuna trial 205 启动:seed=3252 260602-03:44:04 (UTC+8)260602-03:44:05 (UTC+8)
1043P5 Optuna trial 204 完成:val=88.50 test=87.91 MLP=85.39 GNN=87.91 gateSem=0.414 260602-03:44:02 (UTC+8)260602-03:44:04 (UTC+8)
1042P5 Optuna trial 204 启动:seed=3251 260602-03:41:30 (UTC+8)260602-03:41:32 (UTC+8)
1041P5 Optuna trial 203 完成:val=88.63 test=87.83 MLP=85.26 GNN=87.83 gateSem=0.411 260602-03:41:29 (UTC+8)260602-03:41:31 (UTC+8)
1040P5 Optuna trial 203 启动:seed=3250 260602-03:39:13 (UTC+8)260602-03:39:15 (UTC+8)
1039P5 Optuna trial 202 完成:val=88.80 test=87.78 MLP=85.60 GNN=87.83 gateSem=0.420 260602-03:39:12 (UTC+8)260602-03:39:14 (UTC+8)
1038P5 Optuna trial 202 启动:seed=3249 260602-03:36:34 (UTC+8)260602-03:36:35 (UTC+8)
1037P5 Optuna trial 201 完成:val=88.72 test=88.00 MLP=85.82 GNN=87.74 gateSem=0.412 260602-03:36:32 (UTC+8)260602-03:36:34 (UTC+8)
1036P5 Optuna trial 200 完成:val=88.25 test=87.06 MLP=83.98 GNN=87.95 gateSem=0.431 260602-03:33:56 (UTC+8)260602-03:33:57 (UTC+8)
1035P5 Optuna trial 200 启动:seed=3247 260602-03:32:30 (UTC+8)260602-03:32:31 (UTC+8)
1034P5 Optuna trial 199 启动:seed=3246 260602-03:30:06 (UTC+8)260602-03:30:08 (UTC+8)
1033P5 Optuna trial 198 完成:val=88.38 test=87.74 MLP=84.75 GNN=87.87 gateSem=0.414 260602-03:30:05 (UTC+8)260602-03:30:07 (UTC+8)
1032P5 Optuna trial 198 启动:seed=3245 260602-03:28:03 (UTC+8)260602-03:28:04 (UTC+8)
1031P5 Optuna trial 197 完成:val=88.38 test=87.83 MLP=85.99 GNN=87.74 gateSem=0.416 260602-03:28:01 (UTC+8)260602-03:28:02 (UTC+8)
1030P5 Optuna trial 197 启动:seed=3244 260602-03:24:38 (UTC+8)260602-03:24:39 (UTC+8)
1029P5 Optuna trial 196 完成:val=88.68 test=87.61 MLP=84.54 GNN=88.00 gateSem=0.410 260602-03:24:36 (UTC+8)260602-03:24:37 (UTC+8)
1028P5 Optuna trial 196 启动:seed=3243 260602-03:22:28 (UTC+8)260602-03:22:29 (UTC+8)
1027P5 Optuna trial 195 完成:val=88.46 test=87.83 MLP=85.05 GNN=88.17 gateSem=0.420 260602-03:22:27 (UTC+8)260602-03:22:28 (UTC+8)
1026P5 Optuna trial 195 启动:seed=3242 260602-03:20:07 (UTC+8)260602-03:20:09 (UTC+8)
1025P5 Optuna trial 194 完成:val=88.16 test=86.97 MLP=85.31 GNN=87.53 gateSem=0.482 260602-03:20:06 (UTC+8)260602-03:20:07 (UTC+8)
1024P5 Optuna trial 194 启动:seed=3241 260602-03:18:47 (UTC+8)260602-03:18:50 (UTC+8)
1023P5 Optuna trial 193 完成:val=88.89 test=87.87 MLP=85.05 GNN=87.91 gateSem=0.415 260602-03:18:47 (UTC+8)260602-03:18:48 (UTC+8)
1022P5 Optuna trial 192 完成:val=88.42 test=87.95 MLP=85.60 GNN=87.91 gateSem=0.428 260602-03:17:13 (UTC+8)260602-03:17:14 (UTC+8)
1021P5 Optuna trial 192 启动:seed=3239 260602-03:14:46 (UTC+8)260602-03:14:50 (UTC+8)
1020P5 Optuna trial 191 完成:val=88.46 test=87.48 MLP=83.64 GNN=87.83 gateSem=0.429 260602-03:14:45 (UTC+8)260602-03:14:49 (UTC+8)
1019P5 Optuna trial 191 启动:seed=3238 260602-03:13:15 (UTC+8)260602-03:13:16 (UTC+8)
1018P5 Optuna trial 190 完成:val=88.33 test=87.23 MLP=83.68 GNN=87.74 gateSem=0.443 260602-03:13:14 (UTC+8)260602-03:13:15 (UTC+8)
1017P5 Optuna trial 190 启动:seed=3237 260602-03:11:45 (UTC+8)260602-03:11:47 (UTC+8)
1016P5 Optuna trial 189 完成:val=88.63 test=87.83 MLP=84.88 GNN=87.78 gateSem=0.429 260602-03:11:44 (UTC+8)260602-03:11:46 (UTC+8)
1015P5 Optuna trial 189 启动:seed=3236 260602-03:09:42 (UTC+8)260602-03:09:43 (UTC+8)
1014P5 Optuna trial 188 完成:val=84.66 test=84.28 MLP=80.52 GNN=84.96 gateSem=0.476 260602-03:09:41 (UTC+8)260602-03:09:42 (UTC+8)
1013P5 Optuna trial 188 启动:seed=3235 260602-03:08:49 (UTC+8)260602-03:08:51 (UTC+8)
1012P5 Optuna trial 187 完成:val=88.72 test=87.78 MLP=85.52 GNN=88.00 gateSem=0.427 260602-03:08:48 (UTC+8)260602-03:08:50 (UTC+8)
1011P5 Optuna trial 187 启动:seed=3234 260602-03:06:15 (UTC+8)260602-03:06:17 (UTC+8)
1010P5 Optuna trial 186 完成:val=88.72 test=87.61 MLP=85.86 GNN=87.44 gateSem=0.431 260602-03:06:14 (UTC+8)260602-03:06:16 (UTC+8)
1009P5 Optuna trial 186 启动:seed=3233 260602-03:03:34 (UTC+8)260602-03:03:35 (UTC+8)
1008P5 Optuna trial 185 启动:seed=3232 260602-03:01:50 (UTC+8)260602-03:01:51 (UTC+8)
1007P5 Optuna trial 184 完成:val=88.59 test=88.00 MLP=86.12 GNN=87.78 gateSem=0.456 260602-03:01:49 (UTC+8)260602-03:01:50 (UTC+8)
1006P5 Optuna trial 184 启动:seed=3231 260602-03:00:09 (UTC+8)260602-03:00:10 (UTC+8)
1005P5 Optuna trial 183 启动:seed=3230 260602-02:57:37 (UTC+8)260602-02:57:37 (UTC+8)
1004P5 Optuna trial 182 完成:val=88.68 test=87.87 MLP=84.96 GNN=87.91 gateSem=0.451 260602-02:57:34 (UTC+8)260602-02:57:36 (UTC+8)
1003P5 Optuna trial 182 启动:seed=3229 260602-02:55:14 (UTC+8)260602-02:55:15 (UTC+8)
1002P5 Optuna trial 181 完成:val=88.25 test=87.53 MLP=84.11 GNN=88.04 gateSem=0.466 260602-02:55:12 (UTC+8)260602-02:55:14 (UTC+8)
1001P5 Optuna trial 181 启动:seed=3228 260602-02:53:53 (UTC+8)260602-02:53:55 (UTC+8)
1000P5 Optuna trial 180 完成:val=88.21 test=87.44 MLP=83.90 GNN=88.04 gateSem=0.433 260602-02:53:52 (UTC+8)260602-02:53:54 (UTC+8)
999P5 Optuna trial 180 启动:seed=3227 260602-02:52:32 (UTC+8)260602-02:52:33 (UTC+8)
998P5 Optuna trial 179 完成:val=88.03 test=86.93 MLP=84.54 GNN=87.91 gateSem=0.478 260602-02:52:30 (UTC+8)260602-02:52:32 (UTC+8)
997P5 Optuna trial 179 启动:seed=3226 260602-02:50:57 (UTC+8)260602-02:50:58 (UTC+8)
996P5 Optuna trial 178 完成:val=88.29 test=87.23 MLP=84.15 GNN=87.74 gateSem=0.435 260602-02:50:56 (UTC+8)260602-02:50:57 (UTC+8)
995P5 Optuna trial 178 启动:seed=3225 260602-02:49:10 (UTC+8)260602-02:49:12 (UTC+8)
994P5 Optuna trial 177 完成:val=88.55 test=88.30 MLP=85.65 GNN=87.95 gateSem=0.447 260602-02:49:09 (UTC+8)260602-02:49:10 (UTC+8)
993P5 Optuna trial 177 启动:seed=3224 260602-02:46:16 (UTC+8)260602-02:46:17 (UTC+8)
992P5 Optuna trial 176 完成:val=87.65 test=86.89 MLP=84.07 GNN=88.47 gateSem=0.461 260602-02:46:15 (UTC+8)260602-02:46:16 (UTC+8)
991P5 Optuna trial 176 启动:seed=3223 260602-02:45:29 (UTC+8)260602-02:45:30 (UTC+8)
990P5 Optuna trial 175 完成:val=88.50 test=87.65 MLP=84.49 GNN=88.08 gateSem=0.461 260602-02:45:28 (UTC+8)260602-02:45:29 (UTC+8)
989P5 Optuna trial 174 完成:val=88.68 test=88.17 MLP=85.18 GNN=88.25 gateSem=0.457 260602-02:43:30 (UTC+8)260602-02:43:30 (UTC+8)
988P5 Optuna trial 174 启动:seed=3221 260602-02:41:04 (UTC+8)260602-02:41:05 (UTC+8)
987P5 Optuna trial 173 完成:val=88.50 test=87.78 MLP=85.01 GNN=88.04 gateSem=0.443 260602-02:41:02 (UTC+8)260602-02:41:04 (UTC+8)
986P5 Optuna trial 173 启动:seed=3220 260602-02:39:52 (UTC+8)260602-02:39:54 (UTC+8)
985P5 Optuna trial 172 完成:val=88.59 test=88.12 MLP=85.01 GNN=87.83 gateSem=0.439 260602-02:39:51 (UTC+8)260602-02:39:53 (UTC+8)
984P5 Optuna trial 172 启动:seed=3219 260602-02:38:07 (UTC+8)260602-02:38:09 (UTC+8)
983P5 Optuna trial 171 完成:val=88.50 test=88.17 MLP=85.22 GNN=87.78 gateSem=0.437 260602-02:38:05 (UTC+8)260602-02:38:08 (UTC+8)
982P5 Optuna trial 171 启动:seed=3218 260602-02:36:22 (UTC+8)260602-02:36:23 (UTC+8)
981P5 Optuna trial 170 完成:val=88.55 test=87.61 MLP=84.24 GNN=87.95 gateSem=0.430 260602-02:36:21 (UTC+8)260602-02:36:22 (UTC+8)
980P5 Optuna trial 170 启动:seed=3217 260602-02:33:29 (UTC+8)260602-02:33:30 (UTC+8)
979P5 Optuna trial 169 完成:val=88.55 test=88.04 MLP=85.13 GNN=87.78 gateSem=0.446 260602-02:33:28 (UTC+8)260602-02:33:29 (UTC+8)
978P5 Optuna trial 169 启动:seed=3216 260602-02:32:34 (UTC+8)260602-02:32:36 (UTC+8)
977P5 Optuna trial 168 完成:val=88.46 test=87.48 MLP=84.75 GNN=88.00 gateSem=0.437 260602-02:32:33 (UTC+8)260602-02:32:35 (UTC+8)
976P5 Optuna trial 168 启动:seed=3215 260602-02:30:11 (UTC+8)260602-02:30:12 (UTC+8)
975P5 Optuna trial 167 完成:val=88.42 test=87.40 MLP=84.11 GNN=88.34 gateSem=0.430 260602-02:30:10 (UTC+8)260602-02:30:11 (UTC+8)
974P5 Optuna trial 167 启动:seed=3214 260602-02:27:27 (UTC+8)260602-02:27:28 (UTC+8)
973P5 Optuna trial 166 完成:val=88.38 test=87.70 MLP=84.58 GNN=88.17 gateSem=0.434 260602-02:27:25 (UTC+8)260602-02:27:27 (UTC+8)
972P5 Optuna trial 166 启动:seed=3213 260602-02:24:54 (UTC+8)260602-02:24:55 (UTC+8)
971P5 Optuna trial 165 完成:val=88.68 test=87.70 MLP=84.28 GNN=88.04 gateSem=0.433 260602-02:24:53 (UTC+8)260602-02:24:53 (UTC+8)
970P5 Optuna trial 165 启动:seed=3212 260602-02:22:46 (UTC+8)260602-02:22:48 (UTC+8)
969P5 Optuna trial 164 完成:val=88.68 test=87.65 MLP=85.13 GNN=87.95 gateSem=0.442 260602-02:22:45 (UTC+8)260602-02:22:47 (UTC+8)
968P5 Optuna trial 164 启动:seed=3211 260602-02:20:00 (UTC+8)260602-02:20:02 (UTC+8)
967P5 Optuna trial 163 完成:val=88.38 test=88.25 MLP=84.96 GNN=88.00 gateSem=0.435 260602-02:19:59 (UTC+8)260602-02:20:01 (UTC+8)
966P5 Optuna trial 163 启动:seed=3210 260602-02:18:11 (UTC+8)260602-02:18:12 (UTC+8)
965P5 Optuna trial 162 完成:val=88.46 test=88.17 MLP=83.90 GNN=87.91 gateSem=0.437 260602-02:18:10 (UTC+8)260602-02:18:11 (UTC+8)
964P5 Optuna trial 162 启动:seed=3209 260602-02:16:24 (UTC+8)260602-02:16:25 (UTC+8)
963P5 Optuna trial 161 完成:val=88.85 test=87.70 MLP=84.32 GNN=88.12 gateSem=0.431 260602-02:16:23 (UTC+8)260602-02:16:23 (UTC+8)
962P5 Optuna trial 161 启动:seed=3208 260602-02:15:18 (UTC+8)260602-02:15:19 (UTC+8)
961P5 Optuna trial 160 完成:val=88.16 test=87.87 MLP=85.39 GNN=87.61 gateSem=0.488 260602-02:15:16 (UTC+8)260602-02:15:17 (UTC+8)
960P5 Optuna trial 160 启动:seed=3207 260602-02:14:19 (UTC+8)260602-02:14:20 (UTC+8)
959P5 Optuna trial 159 完成:val=88.29 test=87.31 MLP=85.13 GNN=87.65 gateSem=0.481 260602-02:14:18 (UTC+8)260602-02:14:19 (UTC+8)
958P5 Optuna trial 159 启动:seed=3206 260602-02:13:50 (UTC+8)260602-02:13:51 (UTC+8)
957P5 Optuna trial 158 完成:val=88.38 test=87.48 MLP=83.55 GNN=87.74 gateSem=0.470 260602-02:13:48 (UTC+8)260602-02:13:50 (UTC+8)
956P5 Optuna trial 158 启动:seed=3205 260602-02:12:27 (UTC+8)260602-02:12:29 (UTC+8)
955P5 Optuna trial 157 完成:val=88.50 test=87.78 MLP=84.32 GNN=87.57 gateSem=0.453 260602-02:12:26 (UTC+8)260602-02:12:28 (UTC+8)
954P5 Optuna trial 157 启动:seed=3204 260602-02:10:42 (UTC+8)260602-02:10:43 (UTC+8)
953P5 Optuna trial 156 启动:seed=3203 260602-02:09:51 (UTC+8)260602-02:09:52 (UTC+8)
952P5 Optuna trial 155 完成:val=88.33 test=87.87 MLP=85.56 GNN=87.83 gateSem=0.491 260602-02:09:51 (UTC+8)260602-02:09:51 (UTC+8)
951P5 Optuna trial 155 启动:seed=3202 260602-02:07:48 (UTC+8)260602-02:07:49 (UTC+8)
950P5 Optuna trial 154 完成:val=88.12 test=87.27 MLP=84.37 GNN=87.70 gateSem=0.468 260602-02:07:47 (UTC+8)260602-02:07:48 (UTC+8)
949P5 Optuna trial 154 启动:seed=3201 260602-02:06:14 (UTC+8)260602-02:06:16 (UTC+8)
948P5 Optuna trial 153 完成:val=88.38 test=88.00 MLP=84.37 GNN=87.78 gateSem=0.485 260602-02:06:13 (UTC+8)260602-02:06:14 (UTC+8)
947P5 Optuna trial 153 启动:seed=3200 260602-02:04:31 (UTC+8)260602-02:04:33 (UTC+8)
946P5 Optuna trial 152 完成:val=88.46 test=87.91 MLP=84.58 GNN=88.08 gateSem=0.484 260602-02:04:30 (UTC+8)260602-02:04:32 (UTC+8)
945P5 Optuna trial 151 完成:val=88.46 test=88.08 MLP=85.13 GNN=87.83 gateSem=0.486 260602-02:02:18 (UTC+8)260602-02:02:19 (UTC+8)
944P5 Optuna trial 151 启动:seed=3198 260602-02:00:13 (UTC+8)260602-02:00:15 (UTC+8)
943P5 Optuna trial 150 完成:val=88.42 test=87.74 MLP=83.98 GNN=88.21 gateSem=0.431 260602-02:00:12 (UTC+8)260602-02:00:13 (UTC+8)
942P5 Optuna trial 150 启动:seed=3197 260602-01:57:55 (UTC+8)260602-01:57:56 (UTC+8)
941P5 Optuna trial 149 完成:val=88.25 test=87.48 MLP=84.49 GNN=88.21 gateSem=0.431 260602-01:57:54 (UTC+8)260602-01:57:55 (UTC+8)
940P5 Optuna trial 149 启动:seed=3196 260602-01:55:42 (UTC+8)260602-01:55:43 (UTC+8)
939P5 Optuna trial 148 完成:val=85.34 test=84.96 MLP=81.03 GNN=86.20 gateSem=0.494 260602-01:55:41 (UTC+8)260602-01:55:42 (UTC+8)
938P5 Optuna trial 148 启动:seed=3195 260602-01:52:50 (UTC+8)260602-01:52:51 (UTC+8)
937P5 Optuna trial 147 完成:val=88.46 test=87.74 MLP=84.02 GNN=88.25 gateSem=0.460 260602-01:52:49 (UTC+8)260602-01:52:50 (UTC+8)
936P5 Optuna trial 147 启动:seed=3194 260602-01:51:57 (UTC+8)260602-01:51:59 (UTC+8)
935P5 Optuna trial 146 完成:val=88.21 test=88.04 MLP=85.35 GNN=88.04 gateSem=0.488 260602-01:51:56 (UTC+8)260602-01:51:57 (UTC+8)
934P5 Optuna trial 146 启动:seed=3193 260602-01:49:53 (UTC+8)260602-01:49:54 (UTC+8)
933P5 Optuna trial 145 启动:seed=3192 260602-01:48:19 (UTC+8)260602-01:48:20 (UTC+8)
932P5 Optuna trial 144 完成:val=88.55 test=88.08 MLP=85.13 GNN=87.83 gateSem=0.476 260602-01:48:18 (UTC+8)260602-01:48:19 (UTC+8)
931P5 Optuna trial 143 完成:val=88.42 test=87.78 MLP=84.49 GNN=87.95 gateSem=0.474 260602-01:46:18 (UTC+8)260602-01:46:19 (UTC+8)
930P5 Optuna trial 143 启动:seed=3190 260602-01:44:40 (UTC+8)260602-01:44:41 (UTC+8)
929P5 Optuna trial 142 完成:val=88.29 test=87.48 MLP=83.55 GNN=87.83 gateSem=0.462 260602-01:44:39 (UTC+8)260602-01:44:41 (UTC+8)
928P5 Optuna trial 142 启动:seed=3189 260602-01:43:19 (UTC+8)260602-01:43:20 (UTC+8)
927P5 Optuna trial 141 完成:val=88.55 test=87.87 MLP=85.78 GNN=87.74 gateSem=0.475 260602-01:43:17 (UTC+8)260602-01:43:19 (UTC+8)
926P5 Optuna trial 141 启动:seed=3188 260602-01:41:15 (UTC+8)260602-01:41:16 (UTC+8)
925P5 Optuna trial 140 完成:val=88.29 test=88.04 MLP=85.13 GNN=88.12 gateSem=0.477 260602-01:41:14 (UTC+8)260602-01:41:16 (UTC+8)
924P5 Optuna trial 140 启动:seed=3187 260602-01:40:48 (UTC+8)260602-01:40:49 (UTC+8)
923P5 Optuna trial 139 启动:seed=3186 260602-01:38:47 (UTC+8)260602-01:38:48 (UTC+8)
922P5 Optuna trial 138 完成:val=88.46 test=88.21 MLP=85.78 GNN=87.87 gateSem=0.475 260602-01:38:46 (UTC+8)260602-01:38:47 (UTC+8)
921P5 Optuna trial 138 启动:seed=3185 260602-01:37:22 (UTC+8)260602-01:37:23 (UTC+8)
920P5 Optuna trial 137 完成:val=88.46 test=87.78 MLP=85.01 GNN=87.87 gateSem=0.478 260602-01:37:21 (UTC+8)260602-01:37:22 (UTC+8)
919P5 Optuna trial 137 启动:seed=3184 260602-01:36:39 (UTC+8)260602-01:36:40 (UTC+8)
918P5 Optuna trial 136 完成:val=88.46 test=88.25 MLP=85.82 GNN=88.04 gateSem=0.489 260602-01:36:38 (UTC+8)260602-01:36:39 (UTC+8)
917P5 Optuna trial 136 启动:seed=3183 260602-01:34:04 (UTC+8)260602-01:34:06 (UTC+8)
916P5 Optuna trial 135 完成:val=88.50 test=87.74 MLP=84.54 GNN=88.12 gateSem=0.458 260602-01:34:03 (UTC+8)260602-01:34:05 (UTC+8)
915P5 Optuna trial 135 启动:seed=3182 260602-01:32:23 (UTC+8)260602-01:32:25 (UTC+8)
914P5 Optuna trial 134 完成:val=88.29 test=87.18 MLP=84.45 GNN=87.48 gateSem=0.494 260602-01:32:22 (UTC+8)260602-01:32:24 (UTC+8)
913P5 Optuna trial 134 启动:seed=3181 260602-01:31:10 (UTC+8)260602-01:31:13 (UTC+8)
912P5 Optuna trial 133 完成:val=88.55 test=87.78 MLP=84.62 GNN=88.17 gateSem=0.498 260602-01:31:09 (UTC+8)260602-01:31:12 (UTC+8)
911P5 Optuna trial 133 启动:seed=3180 260602-01:29:17 (UTC+8)260602-01:29:19 (UTC+8)
910P5 Optuna trial 132 完成:val=88.50 test=87.36 MLP=83.72 GNN=87.83 gateSem=0.476 260602-01:29:16 (UTC+8)260602-01:29:17 (UTC+8)
909P5 Optuna trial 132 启动:seed=3179 260602-01:27:51 (UTC+8)260602-01:27:53 (UTC+8)
908P5 Optuna trial 131 完成:val=88.50 test=87.36 MLP=84.96 GNN=87.61 gateSem=0.486 260602-01:27:50 (UTC+8)260602-01:27:52 (UTC+8)
907P5 Optuna trial 131 启动:seed=3178 260602-01:26:40 (UTC+8)260602-01:26:41 (UTC+8)
906P5 Optuna trial 130 完成:val=88.42 test=86.72 MLP=84.02 GNN=87.65 gateSem=0.484 260602-01:26:39 (UTC+8)260602-01:26:40 (UTC+8)
905P5 Optuna trial 130 启动:seed=3177 260602-01:25:03 (UTC+8)260602-01:25:04 (UTC+8)
904P5 Optuna trial 129 启动:seed=3176 260602-01:24:18 (UTC+8)260602-01:24:21 (UTC+8)
903P5 Optuna trial 128 完成:val=88.50 test=87.78 MLP=85.31 GNN=87.57 gateSem=0.481 260602-01:24:17 (UTC+8)260602-01:24:20 (UTC+8)
902P5 Optuna trial 128 启动:seed=3175 260602-01:22:17 (UTC+8)260602-01:22:18 (UTC+8)
901P5 Optuna trial 127 完成:val=88.50 test=88.00 MLP=84.24 GNN=87.87 gateSem=0.492 260602-01:22:14 (UTC+8)260602-01:22:16 (UTC+8)
900P5 Optuna trial 127 启动:seed=3174 260602-01:20:04 (UTC+8)260602-01:20:05 (UTC+8)
899P5 Optuna trial 126 完成:val=88.42 test=87.95 MLP=84.11 GNN=88.12 gateSem=0.440 260602-01:20:04 (UTC+8)260602-01:20:04 (UTC+8)
898P5 Optuna trial 125 完成:val=88.46 test=88.00 MLP=85.69 GNN=88.00 gateSem=0.487 260602-01:18:07 (UTC+8)260602-01:18:08 (UTC+8)
897P5 Optuna trial 125 启动:seed=3172 260602-01:16:18 (UTC+8)260602-01:16:19 (UTC+8)
896P5 Optuna trial 124 启动:seed=3171 260602-01:14:32 (UTC+8)260602-01:14:34 (UTC+8)
895P5 Optuna trial 123 完成:val=88.50 test=87.87 MLP=85.13 GNN=88.17 gateSem=0.458 260602-01:14:31 (UTC+8)260602-01:14:33 (UTC+8)
894P5 Optuna trial 123 启动:seed=3170 260602-01:12:32 (UTC+8)260602-01:12:33 (UTC+8)
893P5 Optuna trial 122 完成:val=88.68 test=88.00 MLP=84.96 GNN=88.04 gateSem=0.493 260602-01:12:30 (UTC+8)260602-01:12:32 (UTC+8)
892P5 Optuna trial 122 启动:seed=3169 260602-01:10:15 (UTC+8)260602-01:10:16 (UTC+8)
891P5 Optuna trial 121 完成:val=88.50 test=87.65 MLP=83.38 GNN=88.12 gateSem=0.446 260602-01:10:14 (UTC+8)260602-01:10:15 (UTC+8)
890P5 Optuna trial 121 启动:seed=3168 260602-01:08:35 (UTC+8)260602-01:08:37 (UTC+8)
889P5 Optuna trial 120 完成:val=88.33 test=87.95 MLP=84.49 GNN=88.04 gateSem=0.468 260602-01:08:35 (UTC+8)260602-01:08:36 (UTC+8)
888P5 Optuna trial 120 启动:seed=3167 260602-01:07:07 (UTC+8)260602-01:07:07 (UTC+8)
887P5 Optuna trial 119 完成:val=87.91 test=87.48 MLP=86.33 GNN=87.10 gateSem=0.496 260602-01:07:04 (UTC+8)260602-01:07:06 (UTC+8)
886P5 Optuna trial 118 完成:val=88.25 test=87.48 MLP=83.72 GNN=88.21 gateSem=0.442 260602-01:05:30 (UTC+8)260602-01:05:32 (UTC+8)
885P5 Optuna trial 118 启动:seed=3165 260602-01:04:46 (UTC+8)260602-01:04:48 (UTC+8)
884P5 Optuna trial 117 完成:val=88.29 test=87.57 MLP=84.41 GNN=88.00 gateSem=0.460 260602-01:04:45 (UTC+8)260602-01:04:46 (UTC+8)
883P5 Optuna trial 117 启动:seed=3164 260602-01:03:12 (UTC+8)260602-01:03:13 (UTC+8)
882P5 Optuna trial 116 启动:seed=3163 260602-01:01:35 (UTC+8)260602-01:01:36 (UTC+8)
881P5 Optuna trial 115 完成:val=88.42 test=88.08 MLP=84.54 GNN=88.12 gateSem=0.447 260602-01:01:34 (UTC+8)260602-01:01:35 (UTC+8)
880P5 Optuna trial 115 启动:seed=3162 260602-00:59:38 (UTC+8)260602-00:59:39 (UTC+8)
879P5 Optuna trial 114 完成:val=88.63 test=88.08 MLP=85.35 GNN=88.00 gateSem=0.452 260602-00:59:37 (UTC+8)260602-00:59:38 (UTC+8)
878P5 Optuna trial 114 启动:seed=3161 260602-00:57:10 (UTC+8)260602-00:57:11 (UTC+8)
877P5 Optuna trial 113 完成:val=88.55 test=87.70 MLP=84.49 GNN=88.17 gateSem=0.438 260602-00:57:09 (UTC+8)260602-00:57:10 (UTC+8)
876P5 Optuna trial 113 启动:seed=3160 260602-00:55:31 (UTC+8)260602-00:55:32 (UTC+8)
875P5 Optuna trial 112 完成:val=88.38 test=87.61 MLP=83.98 GNN=87.61 gateSem=0.467 260602-00:55:30 (UTC+8)260602-00:55:30 (UTC+8)
874P5 Optuna trial 112 启动:seed=3159 260602-00:54:08 (UTC+8)260602-00:54:10 (UTC+8)
873P5 Optuna trial 111 完成:val=88.50 test=87.61 MLP=84.32 GNN=87.83 gateSem=0.454 260602-00:54:07 (UTC+8)260602-00:54:09 (UTC+8)
872P5 Optuna trial 111 启动:seed=3158 260602-00:52:22 (UTC+8)260602-00:52:27 (UTC+8)
871P5 Optuna trial 110 完成:val=88.42 test=87.74 MLP=84.37 GNN=88.17 gateSem=0.457 260602-00:52:21 (UTC+8)260602-00:52:26 (UTC+8)
870P5 Optuna trial 110 启动:seed=3157 260602-00:51:55 (UTC+8)260602-00:51:59 (UTC+8)
869P5 Optuna trial 109 完成:val=88.59 test=87.87 MLP=85.05 GNN=88.00 gateSem=0.444 260602-00:51:54 (UTC+8)260602-00:51:58 (UTC+8)
868P5 Optuna trial 109 启动:seed=3156 260602-00:50:06 (UTC+8)260602-00:50:06 (UTC+8)
867P5 Optuna trial 108 完成:val=88.08 test=87.74 MLP=84.75 GNN=87.95 gateSem=0.451 260602-00:50:05 (UTC+8)260602-00:50:06 (UTC+8)
866P5 Optuna trial 108 启动:seed=3155 260602-00:48:24 (UTC+8)260602-00:48:25 (UTC+8)
865P5 Optuna trial 107 完成:val=87.95 test=87.74 MLP=82.74 GNN=88.17 gateSem=0.478 260602-00:48:23 (UTC+8)260602-00:48:24 (UTC+8)
864P5 Optuna trial 107 启动:seed=3154 260602-00:45:30 (UTC+8)260602-00:45:31 (UTC+8)
863P5 Optuna trial 106 完成:val=88.42 test=87.40 MLP=83.98 GNN=87.78 gateSem=0.462 260602-00:45:29 (UTC+8)260602-00:45:30 (UTC+8)
862P5 Optuna trial 106 启动:seed=3153 260602-00:43:28 (UTC+8)260602-00:43:30 (UTC+8)
861P5 Optuna trial 105 完成:val=88.55 test=87.65 MLP=85.05 GNN=88.04 gateSem=0.487 260602-00:43:26 (UTC+8)260602-00:43:28 (UTC+8)
860P5 Optuna trial 105 启动:seed=3152 260602-00:41:33 (UTC+8)260602-00:41:33 (UTC+8)
859P5 Optuna trial 104 完成:val=88.63 test=87.74 MLP=84.41 GNN=87.65 gateSem=0.462 260602-00:41:30 (UTC+8)260602-00:41:32 (UTC+8)
858P5 Optuna trial 104 启动:seed=3151 260602-00:39:50 (UTC+8)260602-00:39:51 (UTC+8)
857P5 Optuna trial 103 完成:val=88.33 test=88.08 MLP=84.41 GNN=87.74 gateSem=0.464 260602-00:39:49 (UTC+8)260602-00:39:50 (UTC+8)
856P5 Optuna trial 103 启动:seed=3150 260602-00:38:11 (UTC+8)260602-00:38:12 (UTC+8)
855P5 Optuna trial 102 完成:val=88.55 test=87.95 MLP=83.90 GNN=88.04 gateSem=0.471 260602-00:38:05 (UTC+8)260602-00:38:11 (UTC+8)
854P5 Optuna trial 102 启动:seed=3149 260602-00:36:35 (UTC+8)260602-00:36:36 (UTC+8)
853P5 Optuna trial 101 完成:val=88.33 test=87.74 MLP=85.05 GNN=87.65 gateSem=0.476 260602-00:36:34 (UTC+8)260602-00:36:35 (UTC+8)
852P5 Optuna trial 101 启动:seed=3148 260602-00:34:50 (UTC+8)260602-00:34:51 (UTC+8)
851P5 Optuna trial 100 完成:val=88.46 test=87.74 MLP=83.08 GNN=88.21 gateSem=0.455 260602-00:34:49 (UTC+8)260602-00:34:50 (UTC+8)
850P5 Optuna trial 100 启动:seed=3147 260602-00:32:09 (UTC+8)260602-00:32:11 (UTC+8)
849P5 Optuna trial 99 完成:val=88.42 test=88.00 MLP=84.79 GNN=88.17 gateSem=0.464 260602-00:32:08 (UTC+8)260602-00:32:09 (UTC+8)
848P5 Optuna trial 99 启动:seed=3146 260602-00:30:16 (UTC+8)260602-00:30:18 (UTC+8)
847P5 Optuna trial 98 完成:val=88.59 test=88.00 MLP=84.41 GNN=88.21 gateSem=0.467 260602-00:30:15 (UTC+8)260602-00:30:17 (UTC+8)
846P5 Optuna trial 98 启动:seed=3145 260602-00:28:20 (UTC+8)260602-00:28:22 (UTC+8)
845P5 Optuna trial 97 完成:val=88.33 test=87.78 MLP=84.41 GNN=88.12 gateSem=0.408 260602-00:28:19 (UTC+8)260602-00:28:21 (UTC+8)
844P5 Optuna trial 97 启动:seed=3144 260602-00:26:36 (UTC+8)260602-00:26:37 (UTC+8)
843P5 Optuna trial 96 完成:val=85.17 test=84.66 MLP=80.73 GNN=84.66 gateSem=0.469 260602-00:26:35 (UTC+8)260602-00:26:36 (UTC+8)
842P5 Optuna trial 96 启动:seed=3143 260602-00:25:46 (UTC+8)260602-00:25:47 (UTC+8)
841P5 Optuna trial 95 启动:seed=3142 260602-00:24:13 (UTC+8)260602-00:24:15 (UTC+8)
840P5 Optuna trial 94 完成:val=88.46 test=87.48 MLP=84.58 GNN=88.25 gateSem=0.456 260602-00:24:12 (UTC+8)260602-00:24:13 (UTC+8)
839P5 Optuna trial 94 启动:seed=3141 260602-00:22:33 (UTC+8)260602-00:22:35 (UTC+8)
838P5 Optuna trial 93 完成:val=88.21 test=88.04 MLP=84.88 GNN=87.53 gateSem=0.426 260602-00:22:32 (UTC+8)260602-00:22:34 (UTC+8)
837P5 Optuna trial 93 启动:seed=3140 260602-00:21:52 (UTC+8)260602-00:21:53 (UTC+8)
836P5 Optuna trial 92 启动:seed=3139 260602-00:21:17 (UTC+8)260602-00:21:18 (UTC+8)
835P5 Optuna trial 91 完成:val=88.38 test=87.10 MLP=84.24 GNN=87.74 gateSem=0.455 260602-00:21:16 (UTC+8)260602-00:21:17 (UTC+8)
834P5 Optuna trial 91 启动:seed=3138 260602-00:20:39 (UTC+8)260602-00:20:40 (UTC+8)
833P5 Optuna trial 90 完成:val=88.29 test=87.65 MLP=84.62 GNN=87.78 gateSem=0.458 260602-00:20:38 (UTC+8)260602-00:20:39 (UTC+8)
832P5 Optuna trial 90 启动:seed=3137 260602-00:18:47 (UTC+8)260602-00:18:48 (UTC+8)
831P5 Optuna trial 89 完成:val=88.33 test=88.00 MLP=85.39 GNN=88.12 gateSem=0.434 260602-00:18:46 (UTC+8)260602-00:18:47 (UTC+8)
830P5 Optuna trial 89 启动:seed=3136 260602-00:17:43 (UTC+8)260602-00:17:44 (UTC+8)
829P5 Optuna trial 88 完成:val=88.38 test=87.48 MLP=84.79 GNN=87.74 gateSem=0.470 260602-00:17:42 (UTC+8)260602-00:17:43 (UTC+8)
828P5 Optuna trial 88 启动:seed=3135 260602-00:15:57 (UTC+8)260602-00:15:59 (UTC+8)
827P5 Optuna trial 87 启动:seed=3134 260602-00:15:00 (UTC+8)260602-00:15:01 (UTC+8)
826P5 Optuna trial 86 完成:val=88.25 test=87.95 MLP=84.62 GNN=88.21 gateSem=0.461 260602-00:14:58 (UTC+8)260602-00:14:59 (UTC+8)
825P5 Optuna trial 86 启动:seed=3133 260602-00:12:51 (UTC+8)260602-00:12:52 (UTC+8)
824P5 Optuna trial 85 完成:val=88.46 test=87.74 MLP=85.43 GNN=88.00 gateSem=0.489 260602-00:12:50 (UTC+8)260602-00:12:50 (UTC+8)
823P5 Optuna trial 85 启动:seed=3132 260602-00:12:04 (UTC+8)260602-00:12:06 (UTC+8)
822P5 Optuna trial 84 完成:val=88.16 test=87.78 MLP=85.82 GNN=87.44 gateSem=0.453 260602-00:12:03 (UTC+8)260602-00:12:05 (UTC+8)
821P5 Optuna trial 84 启动:seed=3131 260602-00:11:06 (UTC+8)260602-00:11:07 (UTC+8)
820P5 Optuna trial 83 完成:val=88.21 test=87.61 MLP=84.37 GNN=88.04 gateSem=0.412 260602-00:11:05 (UTC+8)260602-00:11:06 (UTC+8)
819P5 Optuna trial 82 完成:val=88.38 test=87.70 MLP=83.90 GNN=88.04 gateSem=0.476 260602-00:09:11 (UTC+8)260602-00:09:13 (UTC+8)
818P5 Optuna trial 82 启动:seed=3129 260602-00:07:39 (UTC+8)260602-00:07:40 (UTC+8)
817P5 Optuna trial 81 完成:val=88.03 test=87.40 MLP=87.23 GNN=87.14 gateSem=0.490 260602-00:07:38 (UTC+8)260602-00:07:39 (UTC+8)
816P5 Optuna trial 81 启动:seed=3128 260602-00:06:26 (UTC+8)260602-00:06:29 (UTC+8)
815P5 Optuna trial 80 完成:val=88.42 test=88.00 MLP=84.32 GNN=88.08 gateSem=0.491 260602-00:06:25 (UTC+8)260602-00:06:28 (UTC+8)
814P5 Optuna trial 80 启动:seed=3127 260602-00:04:21 (UTC+8)260602-00:04:23 (UTC+8)
813P5 Optuna trial 79 完成:val=88.46 test=88.04 MLP=84.58 GNN=87.87 gateSem=0.473 260602-00:04:20 (UTC+8)260602-00:04:22 (UTC+8)
812P5 Optuna trial 79 启动:seed=3126 260602-00:02:45 (UTC+8)260602-00:02:47 (UTC+8)
811P5 Optuna trial 78 完成:val=88.42 test=87.40 MLP=83.81 GNN=88.00 gateSem=0.490 260602-00:02:44 (UTC+8)260602-00:02:46 (UTC+8)
810P5 Optuna trial 78 启动:seed=3125 260602-00:00:57 (UTC+8)260602-00:01:00 (UTC+8)
809P5 Optuna trial 77 完成:val=88.08 test=87.83 MLP=84.11 GNN=87.74 gateSem=0.486 260602-00:00:56 (UTC+8)260602-00:00:58 (UTC+8)
808P5 Optuna trial 77 启动:seed=3124 260602-00:00:19 (UTC+8)260602-00:00:20 (UTC+8)
807P5 Optuna trial 76 完成:val=88.50 test=87.83 MLP=83.90 GNN=87.87 gateSem=0.477 260602-00:00:18 (UTC+8)260602-00:00:19 (UTC+8)
806P5 Optuna trial 76 启动:seed=3123 260601-23:58:33 (UTC+8)260601-23:58:33 (UTC+8)
805P5 Optuna trial 75 完成:val=88.42 test=87.78 MLP=84.28 GNN=88.17 gateSem=0.479 260601-23:58:32 (UTC+8)260601-23:58:32 (UTC+8)
804P5 Optuna trial 75 启动:seed=3122 260601-23:57:32 (UTC+8)260601-23:57:33 (UTC+8)
803P5 Optuna trial 74 完成:val=88.42 test=86.93 MLP=83.47 GNN=87.78 gateSem=0.487 260601-23:57:31 (UTC+8)260601-23:57:32 (UTC+8)
802P5 Optuna trial 74 启动:seed=3121 260601-23:56:13 (UTC+8)260601-23:56:14 (UTC+8)
801P5 Optuna trial 73 完成:val=88.38 test=87.48 MLP=84.62 GNN=87.70 gateSem=0.488 260601-23:56:12 (UTC+8)260601-23:56:13 (UTC+8)
800P5 Optuna trial 73 启动:seed=3120 260601-23:55:10 (UTC+8)260601-23:55:11 (UTC+8)
799P5 Optuna trial 72 启动:seed=3119 260601-23:53:39 (UTC+8)260601-23:53:41 (UTC+8)
798P5 Optuna trial 71 完成:val=88.38 test=87.95 MLP=84.41 GNN=87.78 gateSem=0.476 260601-23:53:38 (UTC+8)260601-23:53:40 (UTC+8)
797P5 Optuna trial 71 启动:seed=3118 260601-23:52:05 (UTC+8)260601-23:52:06 (UTC+8)
796P5 Optuna trial 70 完成:val=88.16 test=87.95 MLP=86.03 GNN=87.83 gateSem=0.496 260601-23:52:04 (UTC+8)260601-23:52:05 (UTC+8)
795P5 Optuna trial 70 启动:seed=3117 260601-23:49:41 (UTC+8)260601-23:49:42 (UTC+8)
794P5 Optuna trial 69 完成:val=88.63 test=87.83 MLP=84.62 GNN=87.83 gateSem=0.480 260601-23:49:39 (UTC+8)260601-23:49:41 (UTC+8)
793P5 Optuna trial 69 启动:seed=3116 260601-23:48:05 (UTC+8)260601-23:48:07 (UTC+8)
792P5 Optuna trial 68 完成:val=88.42 test=87.61 MLP=84.92 GNN=87.65 gateSem=0.489 260601-23:48:04 (UTC+8)260601-23:48:06 (UTC+8)
791P5 Optuna trial 68 启动:seed=3115 260601-23:46:41 (UTC+8)260601-23:46:42 (UTC+8)
790P5 Optuna trial 67 启动:seed=3114 260601-23:44:37 (UTC+8)260601-23:44:38 (UTC+8)
789P5 Optuna trial 66 完成:val=88.38 test=87.31 MLP=84.07 GNN=87.78 gateSem=0.495 260601-23:44:36 (UTC+8)260601-23:44:37 (UTC+8)
788P5 Optuna trial 66 启动:seed=3113 260601-23:43:11 (UTC+8)260601-23:43:11 (UTC+8)
787P5 Optuna trial 65 完成:val=88.55 test=87.40 MLP=83.90 GNN=88.08 gateSem=0.486 260601-23:43:09 (UTC+8)260601-23:43:10 (UTC+8)
786P5 Optuna trial 65 启动:seed=3112 260601-23:41:47 (UTC+8)260601-23:41:49 (UTC+8)
785P5 Optuna trial 64 完成:val=88.42 test=87.53 MLP=84.15 GNN=88.00 gateSem=0.496 260601-23:41:46 (UTC+8)260601-23:41:48 (UTC+8)
784P5 Optuna trial 64 启动:seed=3111 260601-23:39:58 (UTC+8)260601-23:40:00 (UTC+8)
783P5 Optuna trial 63 完成:val=88.55 test=87.36 MLP=83.38 GNN=88.00 gateSem=0.499 260601-23:39:57 (UTC+8)260601-23:39:59 (UTC+8)
782P5 Optuna trial 63 启动:seed=3110 260601-23:38:10 (UTC+8)260601-23:38:12 (UTC+8)
781P5 Optuna trial 62 完成:val=88.59 test=87.78 MLP=84.41 GNN=87.95 gateSem=0.466 260601-23:38:09 (UTC+8)260601-23:38:11 (UTC+8)
780P5 Optuna trial 62 启动:seed=3109 260601-23:36:15 (UTC+8)260601-23:36:17 (UTC+8)
779P5 Optuna trial 61 完成:val=88.38 test=88.00 MLP=85.82 GNN=87.83 gateSem=0.459 260601-23:36:14 (UTC+8)260601-23:36:16 (UTC+8)
778P5 Optuna trial 61 启动:seed=3108 260601-23:34:19 (UTC+8)260601-23:34:20 (UTC+8)
777P5 Optuna trial 60 完成:val=84.96 test=84.54 MLP=80.99 GNN=85.26 gateSem=0.485 260601-23:34:17 (UTC+8)260601-23:34:19 (UTC+8)
776P5 Optuna trial 60 启动:seed=3107 260601-23:34:04 (UTC+8)260601-23:34:05 (UTC+8)
775P5 Optuna trial 59 完成:val=88.50 test=87.74 MLP=85.56 GNN=88.08 gateSem=0.452 260601-23:34:03 (UTC+8)260601-23:34:04 (UTC+8)
774P5 Optuna trial 58 完成:val=87.95 test=87.74 MLP=85.60 GNN=87.74 gateSem=0.471 260601-23:33:10 (UTC+8)260601-23:33:11 (UTC+8)
773P5 Optuna trial 57 完成:val=88.42 test=88.04 MLP=85.52 GNN=88.08 gateSem=0.449 260601-23:32:35 (UTC+8)260601-23:32:37 (UTC+8)
772P5 Optuna trial 56 完成:val=88.46 test=87.78 MLP=85.86 GNN=87.18 gateSem=0.461 260601-23:31:49 (UTC+8)260601-23:31:50 (UTC+8)
771P5 Optuna trial 56 启动:seed=3103 260601-23:30:34 (UTC+8)260601-23:30:35 (UTC+8)
770P5 Optuna trial 55 完成:val=87.91 test=87.48 MLP=87.44 GNN=86.63 gateSem=0.487 260601-23:30:33 (UTC+8)260601-23:30:34 (UTC+8)
769P5 Optuna trial 54 完成:val=88.08 test=87.36 MLP=84.84 GNN=87.74 gateSem=0.471 260601-23:29:58 (UTC+8)260601-23:29:59 (UTC+8)
768P5 Optuna trial 54 启动:seed=3101 260601-23:29:39 (UTC+8)260601-23:29:40 (UTC+8)
767P5 Optuna trial 53 完成:val=88.38 test=87.70 MLP=83.94 GNN=88.30 gateSem=0.423 260601-23:29:37 (UTC+8)260601-23:29:39 (UTC+8)
766P5 Optuna trial 53 启动:seed=3100 260601-23:29:08 (UTC+8)260601-23:29:09 (UTC+8)
765P5 Optuna trial 52 完成:val=88.42 test=87.14 MLP=84.24 GNN=88.25 gateSem=0.474 260601-23:29:06 (UTC+8)260601-23:29:08 (UTC+8)
764P5 Optuna trial 51 完成:val=88.25 test=87.83 MLP=84.41 GNN=88.00 gateSem=0.451 260601-23:28:33 (UTC+8)260601-23:28:36 (UTC+8)
763P5 Optuna trial 51 启动:seed=3098 260601-23:28:05 (UTC+8)260601-23:28:07 (UTC+8)
762P5 Optuna trial 50 完成:val=88.42 test=87.31 MLP=83.90 GNN=87.65 gateSem=0.439 260601-23:28:04 (UTC+8)260601-23:28:06 (UTC+8)
761P5 Optuna trial 50 启动:seed=3097 260601-23:26:02 (UTC+8)260601-23:26:03 (UTC+8)
760P5 Optuna trial 49 完成:val=86.88 test=86.46 MLP=82.10 GNN=87.70 gateSem=0.483 260601-23:26:01 (UTC+8)260601-23:26:02 (UTC+8)
759P5 Optuna trial 49 启动:seed=3096 260601-23:24:33 (UTC+8)260601-23:24:34 (UTC+8)
758P5 Optuna trial 48 完成:val=88.33 test=87.95 MLP=84.88 GNN=87.83 gateSem=0.441 260601-23:24:31 (UTC+8)260601-23:24:33 (UTC+8)
757P5 Optuna trial 48 启动:seed=3095 260601-23:23:04 (UTC+8)260601-23:23:05 (UTC+8)
756P5 Optuna trial 47 完成:val=88.55 test=87.53 MLP=84.37 GNN=88.04 gateSem=0.450 260601-23:23:03 (UTC+8)260601-23:23:04 (UTC+8)
755P5 Optuna trial 47 启动:seed=3094 260601-23:22:38 (UTC+8)260601-23:22:39 (UTC+8)
754P5 Optuna trial 46 完成:val=87.65 test=87.61 MLP=83.94 GNN=88.38 gateSem=0.481 260601-23:22:37 (UTC+8)260601-23:22:38 (UTC+8)
753P5 Optuna trial 46 启动:seed=3093 260601-23:21:16 (UTC+8)260601-23:21:17 (UTC+8)
752P5 Optuna trial 45 完成:val=88.42 test=87.83 MLP=84.37 GNN=87.87 gateSem=0.429 260601-23:21:15 (UTC+8)260601-23:21:15 (UTC+8)
751P5 Optuna trial 45 启动:seed=3092 260601-23:20:13 (UTC+8)260601-23:20:14 (UTC+8)
750P5 Optuna trial 44 完成:val=88.33 test=87.27 MLP=83.60 GNN=88.04 gateSem=0.477 260601-23:20:12 (UTC+8)260601-23:20:13 (UTC+8)
749P5 Optuna trial 44 启动:seed=3091 260601-23:18:17 (UTC+8)260601-23:18:18 (UTC+8)
748P5 Optuna trial 43 完成:val=88.50 test=87.48 MLP=83.51 GNN=88.12 gateSem=0.445 260601-23:18:15 (UTC+8)260601-23:18:17 (UTC+8)
747P5 Optuna trial 43 启动:seed=3090 260601-23:16:17 (UTC+8)260601-23:16:21 (UTC+8)
746P5 Optuna trial 42 完成:val=88.33 test=87.27 MLP=84.02 GNN=88.04 gateSem=0.472 260601-23:16:15 (UTC+8)260601-23:16:20 (UTC+8)
745P5 Optuna trial 41 完成:val=88.46 test=87.65 MLP=84.71 GNN=87.78 gateSem=0.461 260601-23:15:39 (UTC+8)260601-23:15:41 (UTC+8)
744P5 Optuna trial 41 启动:seed=3088 260601-23:14:04 (UTC+8)260601-23:14:06 (UTC+8)
743P5 Optuna trial 40 完成:val=88.33 test=87.78 MLP=86.07 GNN=88.12 gateSem=0.444 260601-23:14:03 (UTC+8)260601-23:14:05 (UTC+8)
742P5 Optuna trial 40 启动:seed=3087 260601-23:11:27 (UTC+8)260601-23:11:29 (UTC+8)
741P5 Phase1 跳过:复用已有 best-val cache phase1_cache_wikics_bestVal.pt 260601-23:11:25 (UTC+8)260601-23:11:27 (UTC+8)
740P5 启动:Phase1 best-val cache + Phase2 MacroFusion Optuna n_trials=360 device=cuda:0 260601-23:11:25 (UTC+8)260601-23:11:26 (UTC+8)
739全部 Wiki-CS Orthrus P0-P5 队列已处理完成 260601-21:06:17 (UTC+8)260601-21:06:18 (UTC+8)
738完成核心实验:P5 260601-21:06:16 (UTC+8)260601-21:06:17 (UTC+8)
737P5 完成:best_trial=29 best_val=88.63 260601-21:06:14 (UTC+8)260601-21:06:15 (UTC+8)
736P5 Optuna trial 39 完成:val=88.16 test=87.36 MLP=87.70 GNN=87.06 gateSem=0.494 260601-21:06:13 (UTC+8)260601-21:06:14 (UTC+8)
735P5 Optuna trial 39 启动:seed=3086 260601-21:04:44 (UTC+8)260601-21:04:46 (UTC+8)
734P5 Optuna trial 38 完成:val=88.50 test=87.48 MLP=84.79 GNN=87.61 gateSem=0.436 260601-21:04:43 (UTC+8)260601-21:04:45 (UTC+8)
733P5 Optuna trial 38 启动:seed=3085 260601-21:03:22 (UTC+8)260601-21:03:23 (UTC+8)
732P5 Optuna trial 37 完成:val=88.55 test=87.70 MLP=84.45 GNN=88.04 gateSem=0.454 260601-21:03:20 (UTC+8)260601-21:03:22 (UTC+8)
731P5 Optuna trial 37 启动:seed=3084 260601-21:01:59 (UTC+8)260601-21:01:59 (UTC+8)
730P5 Optuna trial 36 完成:val=88.42 test=87.70 MLP=84.11 GNN=87.74 gateSem=0.485 260601-21:01:58 (UTC+8)260601-21:01:58 (UTC+8)
729P5 Optuna trial 36 启动:seed=3083 260601-21:00:22 (UTC+8)260601-21:00:22 (UTC+8)
728P5 Optuna trial 35 完成:val=87.78 test=87.06 MLP=82.79 GNN=87.40 gateSem=0.464 260601-21:00:21 (UTC+8)260601-21:00:22 (UTC+8)
727P5 Optuna trial 35 启动:seed=3082 260601-20:58:50 (UTC+8)260601-20:58:52 (UTC+8)
726P5 Optuna trial 34 完成:val=88.59 test=87.70 MLP=84.75 GNN=88.12 gateSem=0.468 260601-20:58:49 (UTC+8)260601-20:58:51 (UTC+8)
725P5 Optuna trial 34 启动:seed=3081 260601-20:57:09 (UTC+8)260601-20:57:10 (UTC+8)
724P5 Optuna trial 33 完成:val=88.12 test=87.65 MLP=85.90 GNN=87.83 gateSem=0.488 260601-20:57:08 (UTC+8)260601-20:57:09 (UTC+8)
723P5 Optuna trial 33 启动:seed=3080 260601-20:56:05 (UTC+8)260601-20:56:07 (UTC+8)
722P5 Optuna trial 32 完成:val=88.21 test=87.87 MLP=84.71 GNN=87.95 gateSem=0.465 260601-20:56:04 (UTC+8)260601-20:56:06 (UTC+8)
721P5 Optuna trial 32 启动:seed=3079 260601-20:54:57 (UTC+8)260601-20:54:57 (UTC+8)
720P5 Optuna trial 31 完成:val=88.46 test=88.04 MLP=85.65 GNN=87.70 gateSem=0.475 260601-20:54:56 (UTC+8)260601-20:54:56 (UTC+8)
719P5 Optuna trial 31 启动:seed=3078 260601-20:53:36 (UTC+8)260601-20:53:37 (UTC+8)
718P5 Optuna trial 30 完成:val=88.21 test=87.31 MLP=84.07 GNN=87.91 gateSem=0.471 260601-20:53:35 (UTC+8)260601-20:53:36 (UTC+8)
717P5 Optuna trial 30 启动:seed=3077 260601-20:51:42 (UTC+8)260601-20:51:43 (UTC+8)
716P5 Optuna trial 29 完成:val=88.63 test=87.87 MLP=85.78 GNN=88.00 gateSem=0.470 260601-20:51:40 (UTC+8)260601-20:51:42 (UTC+8)
715P5 Optuna trial 29 启动:seed=3076 260601-20:49:39 (UTC+8)260601-20:49:43 (UTC+8)
714P5 Optuna trial 28 完成:val=88.21 test=87.57 MLP=84.62 GNN=88.17 gateSem=0.424 260601-20:49:38 (UTC+8)260601-20:49:42 (UTC+8)
713P5 Optuna trial 28 启动:seed=3075 260601-20:48:17 (UTC+8)260601-20:48:18 (UTC+8)
712P5 Optuna trial 27 完成:val=88.08 test=87.53 MLP=86.67 GNN=87.57 gateSem=0.451 260601-20:48:16 (UTC+8)260601-20:48:18 (UTC+8)
711P5 Optuna trial 26 完成:val=87.65 test=86.80 MLP=83.08 GNN=88.17 gateSem=0.466 260601-20:47:27 (UTC+8)260601-20:47:29 (UTC+8)
710P5 Optuna trial 25 完成:val=88.33 test=86.84 MLP=84.84 GNN=87.06 gateSem=0.487 260601-20:46:41 (UTC+8)260601-20:46:42 (UTC+8)
709P5 Optuna trial 25 启动:seed=3072 260601-20:45:41 (UTC+8)260601-20:45:42 (UTC+8)
708P5 Optuna trial 24 完成:val=88.42 test=87.36 MLP=85.01 GNN=87.83 gateSem=0.473 260601-20:45:39 (UTC+8)260601-20:45:41 (UTC+8)
707P5 Optuna trial 24 启动:seed=3071 260601-20:45:15 (UTC+8)260601-20:45:16 (UTC+8)
706P5 Optuna trial 23 完成:val=88.03 test=87.44 MLP=85.39 GNN=87.87 gateSem=0.460 260601-20:45:14 (UTC+8)260601-20:45:15 (UTC+8)
705P5 Optuna trial 23 启动:seed=3070 260601-20:44:51 (UTC+8)260601-20:44:52 (UTC+8)
704P5 Optuna trial 22 完成:val=88.42 test=87.40 MLP=84.41 GNN=87.61 gateSem=0.462 260601-20:44:49 (UTC+8)260601-20:44:50 (UTC+8)
703P5 Optuna trial 22 启动:seed=3069 260601-20:44:30 (UTC+8)260601-20:44:32 (UTC+8)
702P5 Optuna trial 21 启动:seed=3068 260601-20:43:55 (UTC+8)260601-20:43:57 (UTC+8)
701P5 Optuna trial 20 完成:val=88.50 test=87.48 MLP=85.22 GNN=87.95 gateSem=0.452 260601-20:43:54 (UTC+8)260601-20:43:56 (UTC+8)
700P5 Optuna trial 20 启动:seed=3067 260601-20:43:20 (UTC+8)260601-20:43:22 (UTC+8)
699P5 Optuna trial 19 完成:val=88.25 test=86.97 MLP=84.49 GNN=87.10 gateSem=0.471 260601-20:43:19 (UTC+8)260601-20:43:20 (UTC+8)
698P5 Optuna trial 19 启动:seed=3066 260601-20:42:45 (UTC+8)260601-20:42:47 (UTC+8)
697P5 Optuna trial 18 完成:val=88.21 test=87.95 MLP=85.78 GNN=87.74 gateSem=0.461 260601-20:42:44 (UTC+8)260601-20:42:45 (UTC+8)
696P5 Optuna trial 18 启动:seed=3065 260601-20:41:33 (UTC+8)260601-20:41:36 (UTC+8)
695P5 Optuna trial 17 完成:val=87.61 test=87.31 MLP=83.26 GNN=87.53 gateSem=0.448 260601-20:41:32 (UTC+8)260601-20:41:35 (UTC+8)
694P5 Optuna trial 17 启动:seed=3064 260601-20:40:46 (UTC+8)260601-20:40:48 (UTC+8)
693P5 Optuna trial 16 完成:val=88.46 test=87.91 MLP=85.09 GNN=87.91 gateSem=0.465 260601-20:40:44 (UTC+8)260601-20:40:46 (UTC+8)
692P5 Optuna trial 16 启动:seed=3063 260601-20:39:36 (UTC+8)260601-20:39:41 (UTC+8)
691P5 Optuna trial 15 完成:val=88.25 test=87.36 MLP=84.96 GNN=87.40 gateSem=0.475 260601-20:39:33 (UTC+8)260601-20:39:38 (UTC+8)
690P5 Optuna trial 15 启动:seed=3062 260601-20:39:05 (UTC+8)260601-20:39:07 (UTC+8)
689P5 Optuna trial 14 完成:val=88.08 test=87.44 MLP=84.84 GNN=88.25 gateSem=0.431 260601-20:39:04 (UTC+8)260601-20:39:05 (UTC+8)
688P5 Optuna trial 14 启动:seed=3061 260601-20:38:31 (UTC+8)260601-20:38:32 (UTC+8)
687P5 Optuna trial 13 完成:val=88.38 test=86.97 MLP=85.13 GNN=87.57 gateSem=0.478 260601-20:38:29 (UTC+8)260601-20:38:31 (UTC+8)
686P5 Optuna trial 13 启动:seed=3060 260601-20:37:04 (UTC+8)260601-20:37:05 (UTC+8)
685P5 Optuna trial 12 完成:val=88.42 test=87.87 MLP=85.69 GNN=87.27 gateSem=0.474 260601-20:37:03 (UTC+8)260601-20:37:04 (UTC+8)
684P5 Optuna trial 12 启动:seed=3059 260601-20:36:05 (UTC+8)260601-20:36:07 (UTC+8)
683P5 Optuna trial 11 完成:val=88.46 test=87.61 MLP=85.48 GNN=87.70 gateSem=0.468 260601-20:36:03 (UTC+8)260601-20:36:06 (UTC+8)
682P5 Optuna trial 11 启动:seed=3058 260601-20:34:59 (UTC+8)260601-20:35:00 (UTC+8)
681P5 Optuna trial 10 完成:val=88.03 test=87.65 MLP=86.89 GNN=86.80 gateSem=0.467 260601-20:34:58 (UTC+8)260601-20:34:59 (UTC+8)
680P5 Optuna trial 9 完成:val=85.21 test=85.09 MLP=81.29 GNN=84.66 gateSem=0.437 260601-20:33:40 (UTC+8)260601-20:33:42 (UTC+8)
679P5 Optuna trial 9 启动:seed=3056 260601-20:32:37 (UTC+8)260601-20:32:38 (UTC+8)
678P5 Optuna trial 8 完成:val=87.99 test=87.44 MLP=84.84 GNN=87.53 gateSem=0.488 260601-20:32:36 (UTC+8)260601-20:32:37 (UTC+8)
677P5 Optuna trial 8 启动:seed=3055 260601-20:30:25 (UTC+8)260601-20:30:26 (UTC+8)
676P5 Optuna trial 7 完成:val=85.47 test=84.92 MLP=80.39 GNN=85.52 gateSem=0.457 260601-20:30:24 (UTC+8)260601-20:30:26 (UTC+8)
675P5 Optuna trial 7 启动:seed=3054 260601-20:29:22 (UTC+8)260601-20:29:22 (UTC+8)
674P5 Optuna trial 6 完成:val=87.52 test=87.10 MLP=82.83 GNN=88.04 gateSem=0.462 260601-20:29:20 (UTC+8)260601-20:29:21 (UTC+8)
673P5 Optuna trial 6 启动:seed=3053 260601-20:26:30 (UTC+8)260601-20:26:31 (UTC+8)
672P5 Optuna trial 5 完成:val=84.62 test=84.19 MLP=78.98 GNN=85.09 gateSem=0.466 260601-20:26:29 (UTC+8)260601-20:26:30 (UTC+8)
671P5 Optuna trial 4 启动:seed=3051 260601-20:23:41 (UTC+8)260601-20:23:41 (UTC+8)
670P5 Optuna trial 3 完成:val=87.86 test=87.27 MLP=82.87 GNN=87.65 gateSem=0.479 260601-20:23:40 (UTC+8)260601-20:23:40 (UTC+8)
669P5 Optuna trial 3 启动:seed=3050 260601-20:22:38 (UTC+8)260601-20:22:39 (UTC+8)
668P5 Optuna trial 2 完成:val=85.26 test=84.45 MLP=81.03 GNN=85.09 gateSem=0.414 260601-20:22:37 (UTC+8)260601-20:22:38 (UTC+8)
667P5 Optuna trial 2 启动:seed=3049 260601-20:21:55 (UTC+8)260601-20:21:55 (UTC+8)
666P5 Optuna trial 1 完成:val=87.99 test=87.18 MLP=84.58 GNN=86.97 gateSem=0.499 260601-20:21:53 (UTC+8)260601-20:21:55 (UTC+8)
665P5 Optuna trial 1 启动:seed=3048 260601-20:21:21 (UTC+8)260601-20:21:22 (UTC+8)
664P5 Optuna trial 0 完成:val=88.42 test=87.31 MLP=84.15 GNN=88.17 gateSem=0.454 260601-20:21:20 (UTC+8)260601-20:21:21 (UTC+8)
663P5 Optuna trial 0 启动:seed=3047 260601-20:20:10 (UTC+8)260601-20:20:12 (UTC+8)
662P5 Phase1 完成:best_val_probe_acc=85.26@425 cache=phase1_cache_wikics_bestVal.pt 260601-20:20:08 (UTC+8)260601-20:20:10 (UTC+8)
661P5 Phase1 epoch=600/600 val_probe_acc=85.02 best=85.26@425 260601-20:20:05 (UTC+8)260601-20:20:06 (UTC+8)
660P5 Phase1 epoch=500/600 val_probe_acc=85.22 best=85.26@425 260601-20:19:46 (UTC+8)260601-20:19:48 (UTC+8)
659P5 Phase1 epoch=425/600 val_probe_acc=85.26 best=85.26@425 260601-20:19:34 (UTC+8)260601-20:19:35 (UTC+8)
658P5 Phase1 epoch=400/600 val_probe_acc=84.96 best=85.08@375 260601-20:19:29 (UTC+8)260601-20:19:30 (UTC+8)
657P5 Phase1 epoch=375/600 val_probe_acc=85.08 best=85.08@375 260601-20:19:25 (UTC+8)260601-20:19:25 (UTC+8)
656P5 Phase1 epoch=350/600 val_probe_acc=84.89 best=84.89@350 260601-20:19:17 (UTC+8)260601-20:19:19 (UTC+8)
655P5 Phase1 epoch=300/600 val_probe_acc=84.22 best=84.68@250 260601-20:19:04 (UTC+8)260601-20:19:05 (UTC+8)
654P5 Phase1 epoch=250/600 val_probe_acc=84.68 best=84.68@250 260601-20:18:55 (UTC+8)260601-20:18:56 (UTC+8)
653P5 Phase1 epoch=200/600 val_probe_acc=83.96 best=83.96@200 260601-20:18:44 (UTC+8)260601-20:18:47 (UTC+8)
652P5 Phase1 epoch=150/600 val_probe_acc=82.46 best=82.46@150 260601-20:18:36 (UTC+8)260601-20:18:38 (UTC+8)
651P5 Phase1 epoch=125/600 val_probe_acc=80.25 best=80.25@125 260601-20:18:31 (UTC+8)260601-20:18:33 (UTC+8)
650P5 Phase1 epoch=100/600 val_probe_acc=78.11 best=78.11@100 260601-20:18:26 (UTC+8)260601-20:18:28 (UTC+8)
649P5 Phase1 epoch=75/600 val_probe_acc=73.95 best=73.95@75 260601-20:18:21 (UTC+8)260601-20:18:23 (UTC+8)
648P5 Phase1 epoch=50/600 val_probe_acc=62.59 best=62.59@50 260601-20:18:17 (UTC+8)260601-20:18:18 (UTC+8)
647P5 Phase1 epoch=25/600 val_probe_acc=53.48 best=53.48@25 260601-20:18:12 (UTC+8)260601-20:18:13 (UTC+8)
646P5 Phase1 epoch=1/600 val_probe_acc=22.29 best=22.29@1 260601-20:18:07 (UTC+8)260601-20:18:08 (UTC+8)
645P5 Phase1 启动:三力解耦 L26 mean_last32 KM bank,按 best-val 保存 cache 260601-20:18:04 (UTC+8)260601-20:18:05 (UTC+8)
644P5 启动:Phase1 best-val cache + Phase2 MacroFusion Optuna n_trials=40 device=cuda:0 260601-20:18:03 (UTC+8)260601-20:18:04 (UTC+8)
643启动核心实验:P5 260601-20:17:59 (UTC+8)260601-20:18:00 (UTC+8)
642P5 将重建 Phase1 cache:missing Phase1 cache 260601-20:17:58 (UTC+8)260601-20:17:59 (UTC+8)
641完成核心实验:P3 260601-20:17:57 (UTC+8)260601-20:17:58 (UTC+8)
640P3 完成:KM bank sanity valid_mean=2.99 norm_mean=8.76 260601-20:17:54 (UTC+8)260601-20:17:56 (UTC+8)
639P3 启动:检查 L26 mean_last32 KM hidden bank 260601-20:17:52 (UTC+8)260601-20:17:54 (UTC+8)
638启动核心实验:P3 260601-20:17:48 (UTC+8)260601-20:17:50 (UTC+8)
637完成核心实验:P4 260601-20:17:48 (UTC+8)260601-20:17:49 (UTC+8)
636P4 完成:L26 mean_last32 KM bank 已写入 embedding_bank,hidden_dim=4096 260601-20:17:45 (UTC+8)260601-20:17:47 (UTC+8)
635P4 hidden 提取进度:35000/35000 prompts 260601-20:17:40 (UTC+8)260601-20:17:41 (UTC+8)
634P4 hidden 提取进度:34000/35000 prompts 260601-20:09:53 (UTC+8)260601-20:09:55 (UTC+8)
633P4 hidden 提取进度:33000/35000 prompts 260601-20:02:12 (UTC+8)260601-20:02:13 (UTC+8)
632P4 hidden 提取进度:32000/35000 prompts 260601-19:54:30 (UTC+8)260601-19:54:32 (UTC+8)
631P4 hidden 提取进度:31000/35000 prompts 260601-19:46:49 (UTC+8)260601-19:46:50 (UTC+8)
630P4 hidden 提取进度:30000/35000 prompts 260601-19:39:16 (UTC+8)260601-19:39:17 (UTC+8)
629P4 hidden 提取进度:29000/35000 prompts 260601-19:31:32 (UTC+8)260601-19:31:34 (UTC+8)
628P4 hidden 提取进度:28000/35000 prompts 260601-19:23:56 (UTC+8)260601-19:23:58 (UTC+8)
627P4 hidden 提取进度:27000/35000 prompts 260601-19:16:11 (UTC+8)260601-19:16:12 (UTC+8)
626P4 hidden 提取进度:26000/35000 prompts 260601-19:08:32 (UTC+8)260601-19:08:34 (UTC+8)
625P4 hidden 提取进度:25000/35000 prompts 260601-19:00:53 (UTC+8)260601-19:00:54 (UTC+8)
624P4 hidden 提取进度:24000/35000 prompts 260601-18:53:11 (UTC+8)260601-18:53:12 (UTC+8)
623P4 hidden 提取进度:22000/35000 prompts 260601-18:37:42 (UTC+8)260601-18:37:43 (UTC+8)
622P4 hidden 提取进度:21000/35000 prompts 260601-18:30:02 (UTC+8)260601-18:30:03 (UTC+8)
621P4 hidden 提取进度:19000/35000 prompts 260601-18:14:37 (UTC+8)260601-18:14:41 (UTC+8)
620P4 hidden 提取进度:18000/35000 prompts 260601-18:07:07 (UTC+8)260601-18:07:07 (UTC+8)
619P4 hidden 提取进度:17000/35000 prompts 260601-17:59:26 (UTC+8)260601-17:59:27 (UTC+8)
618P4 hidden 提取进度:16000/35000 prompts 260601-17:51:46 (UTC+8)260601-17:51:48 (UTC+8)
617P4 hidden 提取进度:15000/35000 prompts 260601-17:44:02 (UTC+8)260601-17:44:04 (UTC+8)
616P4 hidden 提取进度:13000/35000 prompts 260601-17:28:35 (UTC+8)260601-17:28:36 (UTC+8)
615P4 hidden 提取进度:12000/35000 prompts 260601-17:20:57 (UTC+8)260601-17:20:58 (UTC+8)
614P4 hidden 提取进度:11000/35000 prompts 260601-17:13:14 (UTC+8)260601-17:13:15 (UTC+8)
613P4 hidden 提取进度:9000/35000 prompts 260601-16:57:41 (UTC+8)260601-16:57:43 (UTC+8)
612P4 hidden 提取进度:6000/35000 prompts 260601-16:34:32 (UTC+8)260601-16:34:34 (UTC+8)
611P4 hidden 提取进度:5000/35000 prompts 260601-16:26:49 (UTC+8)260601-16:26:49 (UTC+8)
610P4 hidden 提取进度:4000/35000 prompts 260601-16:18:27 (UTC+8)260601-16:19:12 (UTC+8)
609P4 hidden 提取进度:3000/35000 prompts 260601-16:10:52 (UTC+8)260601-16:11:17 (UTC+8)
608P4 hidden 提取进度:2000/35000 prompts 260601-16:03:23 (UTC+8)260601-16:03:29 (UTC+8)
607P4 hidden 提取进度:1000/35000 prompts 260601-15:55:37 (UTC+8)260601-15:55:39 (UTC+8)
606启动核心实验:P4 260601-15:47:33 (UTC+8)260601-15:47:38 (UTC+8)
605P1 SFT step=130/4376 epoch=0.059 loss=2.2104 260601-15:30:10 (UTC+8)260601-15:30:14 (UTC+8)
604P1 SFT step=120/4376 epoch=0.055 loss=2.2997 260601-15:27:41 (UTC+8)260601-15:27:45 (UTC+8)
603P1 SFT step=110/4376 epoch=0.050 loss=2.3458 260601-15:25:01 (UTC+8)260601-15:25:11 (UTC+8)
602P1 SFT step=90/4376 epoch=0.041 loss=2.5779 260601-15:19:57 (UTC+8)260601-15:20:00 (UTC+8)
601P1 SFT step=80/4376 epoch=0.037 loss=2.5791 260601-15:17:19 (UTC+8)260601-15:17:24 (UTC+8)
600P1 SFT step=70/4376 epoch=0.032 loss=2.6888 260601-15:14:48 (UTC+8)260601-15:14:50 (UTC+8)
599P1 SFT step=60/4376 epoch=0.027 loss=2.7774 260601-15:12:15 (UTC+8)260601-15:12:16 (UTC+8)
598P1 SFT step=50/4376 epoch=0.023 loss=2.9242 260601-15:09:46 (UTC+8)260601-15:09:47 (UTC+8)
597P1 SFT step=40/4376 epoch=0.018 loss=3.0562 260601-15:07:14 (UTC+8)260601-15:07:15 (UTC+8)
596P1 SFT step=30/4376 epoch=0.014 loss=3.3016 260601-15:04:41 (UTC+8)260601-15:04:43 (UTC+8)
595P1 SFT step=20/4376 epoch=0.009 loss=3.5414 260601-15:02:07 (UTC+8)260601-15:02:08 (UTC+8)
594P1 SFT step=10/4376 epoch=0.005 loss=3.7260 260601-14:59:36 (UTC+8)260601-14:59:38 (UTC+8)
593P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260601-14:54:37 (UTC+8)260601-14:54:38 (UTC+8)
592启动核心实验:P1 260601-14:54:27 (UTC+8)260601-14:54:28 (UTC+8)
591完成核心实验:P0 260601-14:54:26 (UTC+8)260601-14:54:27 (UTC+8)
590P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260601-14:54:24 (UTC+8)260601-14:54:25 (UTC+8)
589P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260601-14:54:23 (UTC+8)260601-14:54:24 (UTC+8)
588启动核心实验:P0 260601-14:54:19 (UTC+8)260601-14:54:20 (UTC+8)
587run.py 正常启动:device=cuda:0 n_trials=40 start_at=P0 sft_prompts=35000 bank_prompts=35000 | 顺序=P0 tokenized raw embedding -> P1 LLM SFT -> P2 SFT/P4格式审计 -> P4 SFT hidden bank -> P3 sanity -> P5 Optuna 260601-14:54:18 (UTC+8)260601-14:54:19 (UTC+8)
586P5 完成:best_trial=0 best_val=84.36 260601-14:51:23 (UTC+8)260601-14:51:23 (UTC+8)
585P5 Optuna trial 0 完成:val=84.36 test=83.55 MLP=80.31 GNN=84.45 gateSem=0.492 260601-14:51:21 (UTC+8)260601-14:51:23 (UTC+8)
584P5 Optuna trial 0 启动:seed=3047 260601-14:50:57 (UTC+8)260601-14:50:58 (UTC+8)
583P5 Phase1 完成:best_train_probe_acc=38.46@1 cache=phase1_cache_wikics_bestVal.pt 260601-14:50:56 (UTC+8)260601-14:50:57 (UTC+8)
582P5 Phase1 epoch=1/2 train_probe_acc=38.46 best=38.46@1 260601-14:50:54 (UTC+8)260601-14:50:55 (UTC+8)
581P5 Phase1 启动:三力解耦 L26 mean_last32 KM bank,按 best-val 保存 cache 260601-14:50:52 (UTC+8)260601-14:50:53 (UTC+8)
580P5 启动:Phase1 best-val cache + Phase2 MacroFusion Optuna n_trials=1 device=cuda:0 260601-14:50:51 (UTC+8)260601-14:50:52 (UTC+8)
579P3 完成:KM bank sanity valid_mean=0.00 norm_mean=8.74 260601-14:50:21 (UTC+8)260601-14:50:21 (UTC+8)
578P3 启动:检查 L26 mean_last32 KM hidden bank 260601-14:50:19 (UTC+8)260601-14:50:20 (UTC+8)
577P4 完成:L26 mean_last32 KM bank 已写入 embedding_bank,hidden_dim=4096 260601-14:49:05 (UTC+8)260601-14:49:06 (UTC+8)
576P4 hidden 提取进度:10/20 prompts 260601-14:48:53 (UTC+8)260601-14:48:54 (UTC+8)
575P4 hidden 提取进度:2/20 prompts 260601-14:48:48 (UTC+8)260601-14:48:50 (UTC+8)
574P4 启动:加载 LoRA 生成 KM hidden bank | adapter=SFT_LoRA_Adapters_1780219582253114163 layer=L26 pool=mean_last32 260601-14:48:41 (UTC+8)260601-14:48:42 (UTC+8)
573P2 完成:SFT/P4 格式一致性通过 adapter=SFT_LoRA_Adapters_1780219582253114163 260601-14:48:28 (UTC+8)260601-14:48:29 (UTC+8)
572P2 启动:核对 SFT/P4 Alpaca 格式和安全截断 260601-14:48:26 (UTC+8)260601-14:48:27 (UTC+8)
571启动核心实验:P1 260601-14:00:26 (UTC+8)260601-14:00:27 (UTC+8)
570完成核心实验:P0 260601-14:00:25 (UTC+8)260601-14:00:26 (UTC+8)
569P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260601-14:00:23 (UTC+8)260601-14:00:24 (UTC+8)
568P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260601-14:00:22 (UTC+8)260601-14:00:23 (UTC+8)
567启动核心实验:P0 260601-14:00:18 (UTC+8)260601-14:00:19 (UTC+8)
566run.py 正常启动:device=cuda:0 n_trials=40 start_at=P0 sft_prompts=35000 bank_prompts=35000 | 顺序=P0 tokenized raw embedding -> P1 LLM SFT -> P2 SFT/P4格式审计 -> P4 SFT hidden bank -> P3 sanity -> P5 Optuna 260601-14:00:16 (UTC+8)260601-14:00:18 (UTC+8)
565P5 启动:Optuna trial 搜索 n_trials=40 device=cuda:0 260601-13:59:18 (UTC+8)260601-13:59:19 (UTC+8)
564启动核心实验:P2 260601-12:08:36 (UTC+8)260601-12:08:55 (UTC+8)
563完成核心实验:P1 260601-12:08:35 (UTC+8)260601-12:08:54 (UTC+8)
562P1 完成:LLM SFT adapter=SFT_LoRA_Adapters_1780219582253114163 samples=35000 260601-12:08:32 (UTC+8)260601-12:08:51 (UTC+8)
561P1 SFT checkpoint:step=4376 epoch=2.000 260601-12:08:30 (UTC+8)260601-12:08:49 (UTC+8)
560P1 SFT step=4370/4376 epoch=1.997 loss=0.3256 260601-12:07:10 (UTC+8)260601-12:07:25 (UTC+8)
559P1 SFT step=4360/4376 epoch=1.993 loss=0.3299 260601-12:04:46 (UTC+8)260601-12:04:56 (UTC+8)
558P1 SFT step=4350/4376 epoch=1.988 loss=0.3868 260601-12:02:17 (UTC+8)260601-12:02:20 (UTC+8)
557P1 SFT step=4340/4376 epoch=1.984 loss=0.4054 260601-11:59:52 (UTC+8)260601-11:59:54 (UTC+8)
556P1 SFT step=4330/4376 epoch=1.979 loss=0.3932 260601-11:57:19 (UTC+8)260601-11:57:20 (UTC+8)
555P1 SFT step=4320/4376 epoch=1.975 loss=0.3377 260601-11:54:48 (UTC+8)260601-11:54:50 (UTC+8)
554P1 SFT step=4310/4376 epoch=1.970 loss=0.3727 260601-11:52:29 (UTC+8)260601-11:52:29 (UTC+8)
553P1 SFT step=4300/4376 epoch=1.965 loss=0.3511 260601-11:49:57 (UTC+8)260601-11:49:58 (UTC+8)
552P1 SFT step=4290/4376 epoch=1.961 loss=0.4451 260601-11:47:36 (UTC+8)260601-11:47:36 (UTC+8)
551P1 SFT step=4280/4376 epoch=1.956 loss=0.4025 260601-11:44:54 (UTC+8)260601-11:44:55 (UTC+8)
550P1 SFT step=4270/4376 epoch=1.952 loss=0.4180 260601-11:42:15 (UTC+8)260601-11:42:17 (UTC+8)
549P1 SFT step=4260/4376 epoch=1.947 loss=0.3606 260601-11:39:40 (UTC+8)260601-11:39:42 (UTC+8)
548P1 SFT step=4250/4376 epoch=1.943 loss=0.3418 260601-11:37:07 (UTC+8)260601-11:37:09 (UTC+8)
547P1 SFT step=4240/4376 epoch=1.938 loss=0.2999 260601-11:34:38 (UTC+8)260601-11:34:39 (UTC+8)
546P1 SFT step=4230/4376 epoch=1.933 loss=0.3875 260601-11:32:14 (UTC+8)260601-11:32:17 (UTC+8)
545P1 SFT step=4220/4376 epoch=1.929 loss=0.3638 260601-11:29:37 (UTC+8)260601-11:29:38 (UTC+8)
544P1 SFT step=4210/4376 epoch=1.924 loss=0.3502 260601-11:26:59 (UTC+8)260601-11:26:59 (UTC+8)
543P1 SFT step=4200/4376 epoch=1.920 loss=0.3818 260601-11:24:27 (UTC+8)260601-11:24:28 (UTC+8)
542P1 SFT step=4190/4376 epoch=1.915 loss=0.3886 260601-11:21:49 (UTC+8)260601-11:21:50 (UTC+8)
541P1 SFT step=4160/4376 epoch=1.901 loss=0.3577 260601-11:14:08 (UTC+8)260601-11:14:09 (UTC+8)
540P1 SFT step=4150/4376 epoch=1.897 loss=0.3837 260601-11:11:46 (UTC+8)260601-11:11:47 (UTC+8)
539P1 SFT step=4140/4376 epoch=1.892 loss=0.4155 260601-11:09:13 (UTC+8)260601-11:09:15 (UTC+8)
538P1 SFT step=4130/4376 epoch=1.888 loss=0.4020 260601-11:06:37 (UTC+8)260601-11:06:38 (UTC+8)
537P1 SFT step=4120/4376 epoch=1.883 loss=0.4526 260601-11:02:52 (UTC+8)260601-11:04:06 (UTC+8)
536P1 SFT step=4110/4376 epoch=1.879 loss=0.3661 260601-11:00:24 (UTC+8)260601-11:01:32 (UTC+8)
535P1 SFT step=4100/4376 epoch=1.874 loss=0.3434 260601-10:57:58 (UTC+8)260601-10:59:00 (UTC+8)
534P1 SFT step=4090/4376 epoch=1.869 loss=0.3729 260601-10:55:31 (UTC+8)260601-10:56:27 (UTC+8)
533P1 SFT step=4080/4376 epoch=1.865 loss=0.3778 260601-10:53:02 (UTC+8)260601-10:53:51 (UTC+8)
532P1 SFT step=4070/4376 epoch=1.860 loss=0.4354 260601-10:50:42 (UTC+8)260601-10:51:26 (UTC+8)
531P1 SFT step=4060/4376 epoch=1.856 loss=0.3934 260601-10:48:20 (UTC+8)260601-10:48:58 (UTC+8)
530P1 SFT step=4050/4376 epoch=1.851 loss=0.3477 260601-10:45:59 (UTC+8)260601-10:46:31 (UTC+8)
529P1 SFT step=4040/4376 epoch=1.847 loss=0.3905 260601-10:43:36 (UTC+8)260601-10:44:02 (UTC+8)
528P1 SFT step=4010/4376 epoch=1.833 loss=0.4066 260601-10:36:11 (UTC+8)260601-10:36:18 (UTC+8)
527P1 SFT step=4000/4376 epoch=1.828 loss=0.4002 260601-10:33:49 (UTC+8)260601-10:33:51 (UTC+8)
526P1 SFT step=3990/4376 epoch=1.824 loss=0.4104 260601-10:31:17 (UTC+8)260601-10:31:19 (UTC+8)
525P1 SFT step=3980/4376 epoch=1.819 loss=0.4438 260601-10:28:47 (UTC+8)260601-10:28:49 (UTC+8)
524P1 SFT step=3970/4376 epoch=1.815 loss=0.3606 260601-10:26:12 (UTC+8)260601-10:26:13 (UTC+8)
523P1 SFT step=3950/4376 epoch=1.805 loss=0.4195 260601-10:20:58 (UTC+8)260601-10:21:00 (UTC+8)
522P1 SFT step=3940/4376 epoch=1.801 loss=0.4099 260601-10:18:22 (UTC+8)260601-10:18:23 (UTC+8)
521P1 SFT step=3930/4376 epoch=1.796 loss=0.3897 260601-10:15:42 (UTC+8)260601-10:15:44 (UTC+8)
520P1 SFT step=3910/4376 epoch=1.787 loss=0.4280 260601-10:10:37 (UTC+8)260601-10:10:38 (UTC+8)
519P1 SFT step=3900/4376 epoch=1.783 loss=0.4503 260601-10:08:07 (UTC+8)260601-10:08:08 (UTC+8)
518P1 SFT step=3890/4376 epoch=1.778 loss=0.3943 260601-10:05:27 (UTC+8)260601-10:05:28 (UTC+8)
517P1 SFT step=3880/4376 epoch=1.773 loss=0.3290 260601-10:02:45 (UTC+8)260601-10:02:46 (UTC+8)
516P1 SFT step=3870/4376 epoch=1.769 loss=0.3890 260601-10:00:11 (UTC+8)260601-10:00:12 (UTC+8)
515P1 SFT step=3860/4376 epoch=1.764 loss=0.4170 260601-09:57:30 (UTC+8)260601-09:57:32 (UTC+8)
514P1 SFT step=3850/4376 epoch=1.760 loss=0.3955 260601-09:54:52 (UTC+8)260601-09:54:53 (UTC+8)
513P1 SFT step=3840/4376 epoch=1.755 loss=0.3982 260601-09:52:17 (UTC+8)260601-09:52:19 (UTC+8)
512P1 SFT step=3830/4376 epoch=1.751 loss=0.3998 260601-09:48:46 (UTC+8)260601-09:49:44 (UTC+8)
511P1 SFT step=3820/4376 epoch=1.746 loss=0.3899 260601-09:46:20 (UTC+8)260601-09:47:12 (UTC+8)
510P1 SFT step=3800/4376 epoch=1.737 loss=0.3819 260601-09:41:19 (UTC+8)260601-09:41:58 (UTC+8)
509P1 SFT step=3790/4376 epoch=1.732 loss=0.3552 260601-09:38:53 (UTC+8)260601-09:39:27 (UTC+8)
508P1 SFT step=3780/4376 epoch=1.728 loss=0.3965 260601-09:36:26 (UTC+8)260601-09:36:53 (UTC+8)
507P1 SFT step=3770/4376 epoch=1.723 loss=0.3446 260601-09:33:51 (UTC+8)260601-09:34:11 (UTC+8)
506P1 SFT step=3760/4376 epoch=1.719 loss=0.3790 260601-09:31:23 (UTC+8)260601-09:31:38 (UTC+8)
505P1 SFT step=3750/4376 epoch=1.714 loss=0.3615 260601-09:28:55 (UTC+8)260601-09:29:03 (UTC+8)
504P1 SFT step=3740/4376 epoch=1.709 loss=0.3755 260601-09:26:31 (UTC+8)260601-09:26:33 (UTC+8)
503P1 SFT step=3730/4376 epoch=1.705 loss=0.3911 260601-09:24:00 (UTC+8)260601-09:24:04 (UTC+8)
502P1 SFT step=3720/4376 epoch=1.700 loss=0.3505 260601-09:21:21 (UTC+8)260601-09:21:22 (UTC+8)
501P1 SFT step=3700/4376 epoch=1.691 loss=0.4066 260601-09:16:12 (UTC+8)260601-09:16:15 (UTC+8)
500P1 SFT step=3690/4376 epoch=1.687 loss=0.3916 260601-09:13:46 (UTC+8)260601-09:13:48 (UTC+8)
499P1 SFT step=3680/4376 epoch=1.682 loss=0.4181 260601-09:11:09 (UTC+8)260601-09:11:10 (UTC+8)
498P1 SFT step=3670/4376 epoch=1.677 loss=0.4127 260601-09:08:26 (UTC+8)260601-09:08:27 (UTC+8)
497P1 SFT step=3660/4376 epoch=1.673 loss=0.3664 260601-09:05:48 (UTC+8)260601-09:05:49 (UTC+8)
496P1 SFT step=3650/4376 epoch=1.668 loss=0.4058 260601-09:03:15 (UTC+8)260601-09:03:16 (UTC+8)
495P1 SFT step=3640/4376 epoch=1.664 loss=0.4550 260601-09:00:37 (UTC+8)260601-09:00:41 (UTC+8)
494P1 SFT step=3630/4376 epoch=1.659 loss=0.3807 260601-08:58:00 (UTC+8)260601-08:58:01 (UTC+8)
493P1 SFT step=3620/4376 epoch=1.655 loss=0.4109 260601-08:55:22 (UTC+8)260601-08:55:26 (UTC+8)
492P1 SFT step=3610/4376 epoch=1.650 loss=0.3397 260601-08:52:50 (UTC+8)260601-08:52:51 (UTC+8)
491P1 SFT step=3600/4376 epoch=1.645 loss=0.4129 260601-08:50:24 (UTC+8)260601-08:50:25 (UTC+8)
490P1 SFT step=3590/4376 epoch=1.641 loss=0.3533 260601-08:47:51 (UTC+8)260601-08:47:52 (UTC+8)
489P1 SFT step=3580/4376 epoch=1.636 loss=0.3900 260601-08:44:21 (UTC+8)260601-08:45:18 (UTC+8)
488P1 SFT step=3570/4376 epoch=1.632 loss=0.4089 260601-08:41:58 (UTC+8)260601-08:42:50 (UTC+8)
487P1 SFT step=3560/4376 epoch=1.627 loss=0.4164 260601-08:39:31 (UTC+8)260601-08:40:16 (UTC+8)
486P1 SFT step=3550/4376 epoch=1.623 loss=0.4121 260601-08:37:00 (UTC+8)260601-08:37:39 (UTC+8)
485P1 SFT step=3540/4376 epoch=1.618 loss=0.4300 260601-08:34:33 (UTC+8)260601-08:35:07 (UTC+8)
484P1 SFT step=3510/4376 epoch=1.604 loss=0.4036 260601-08:27:11 (UTC+8)260601-08:27:26 (UTC+8)
483P1 SFT step=3500/4376 epoch=1.600 loss=0.3602 260601-08:24:41 (UTC+8)260601-08:24:49 (UTC+8)
482P1 SFT step=3490/4376 epoch=1.595 loss=0.3793 260601-08:22:15 (UTC+8)260601-08:22:17 (UTC+8)
481P1 SFT step=3480/4376 epoch=1.591 loss=0.3756 260601-08:19:45 (UTC+8)260601-08:19:46 (UTC+8)
480P1 SFT step=3460/4376 epoch=1.581 loss=0.4767 260601-08:14:47 (UTC+8)260601-08:14:47 (UTC+8)
479P1 SFT step=3450/4376 epoch=1.577 loss=0.3734 260601-08:12:15 (UTC+8)260601-08:12:17 (UTC+8)
478P1 SFT step=3440/4376 epoch=1.572 loss=0.4134 260601-08:09:44 (UTC+8)260601-08:09:45 (UTC+8)
477P1 SFT step=3430/4376 epoch=1.568 loss=0.3837 260601-08:07:12 (UTC+8)260601-08:07:14 (UTC+8)
476P1 SFT step=3420/4376 epoch=1.563 loss=0.4212 260601-08:04:43 (UTC+8)260601-08:04:44 (UTC+8)
475P1 SFT step=3410/4376 epoch=1.559 loss=0.4131 260601-08:02:05 (UTC+8)260601-08:02:06 (UTC+8)
474P1 SFT step=3390/4376 epoch=1.549 loss=0.4226 260601-07:56:50 (UTC+8)260601-07:56:52 (UTC+8)
473P1 SFT step=3380/4376 epoch=1.545 loss=0.4100 260601-07:54:19 (UTC+8)260601-07:54:20 (UTC+8)
472P1 SFT step=3370/4376 epoch=1.540 loss=0.4336 260601-07:51:43 (UTC+8)260601-07:51:45 (UTC+8)
471P1 SFT step=3360/4376 epoch=1.536 loss=0.4158 260601-07:49:07 (UTC+8)260601-07:49:08 (UTC+8)
470P1 SFT step=3350/4376 epoch=1.531 loss=0.4106 260601-07:46:38 (UTC+8)260601-07:46:40 (UTC+8)
469P1 SFT step=3340/4376 epoch=1.527 loss=0.4436 260601-07:44:10 (UTC+8)260601-07:44:12 (UTC+8)
468P1 SFT step=3330/4376 epoch=1.522 loss=0.4158 260601-07:41:39 (UTC+8)260601-07:41:40 (UTC+8)
467P1 SFT step=3320/4376 epoch=1.517 loss=0.4419 260601-07:39:06 (UTC+8)260601-07:39:07 (UTC+8)
466P1 SFT step=3310/4376 epoch=1.513 loss=0.4404 260601-07:36:29 (UTC+8)260601-07:36:30 (UTC+8)
465P1 SFT step=3300/4376 epoch=1.508 loss=0.4805 260601-07:33:52 (UTC+8)260601-07:33:53 (UTC+8)
464P1 SFT step=3290/4376 epoch=1.504 loss=0.3688 260601-07:31:20 (UTC+8)260601-07:31:20 (UTC+8)
463P1 SFT step=3280/4376 epoch=1.499 loss=0.4542 260601-07:28:50 (UTC+8)260601-07:28:52 (UTC+8)
462P1 SFT step=3270/4376 epoch=1.495 loss=0.4113 260601-07:26:20 (UTC+8)260601-07:26:22 (UTC+8)
461P1 SFT step=3260/4376 epoch=1.490 loss=0.4219 260601-07:23:48 (UTC+8)260601-07:23:49 (UTC+8)
460P1 SFT step=3250/4376 epoch=1.485 loss=0.4435 260601-07:21:19 (UTC+8)260601-07:21:20 (UTC+8)
459P1 SFT step=3240/4376 epoch=1.481 loss=0.4336 260601-07:18:43 (UTC+8)260601-07:18:43 (UTC+8)
458P1 SFT step=3230/4376 epoch=1.476 loss=0.4479 260601-07:16:06 (UTC+8)260601-07:16:07 (UTC+8)
457P1 SFT step=3220/4376 epoch=1.472 loss=0.4559 260601-07:13:28 (UTC+8)260601-07:13:30 (UTC+8)
456P1 SFT step=3210/4376 epoch=1.467 loss=0.3956 260601-07:11:01 (UTC+8)260601-07:11:02 (UTC+8)
455P1 SFT step=3200/4376 epoch=1.463 loss=0.4856 260601-07:08:20 (UTC+8)260601-07:08:21 (UTC+8)
454P1 SFT step=3190/4376 epoch=1.458 loss=0.4477 260601-07:05:49 (UTC+8)260601-07:05:51 (UTC+8)
453P1 SFT step=3180/4376 epoch=1.453 loss=0.4266 260601-07:03:10 (UTC+8)260601-07:03:11 (UTC+8)
452P1 SFT step=3170/4376 epoch=1.449 loss=0.4418 260601-07:00:40 (UTC+8)260601-07:00:40 (UTC+8)
451P1 SFT step=3160/4376 epoch=1.444 loss=0.4687 260601-06:58:07 (UTC+8)260601-06:58:09 (UTC+8)
450P1 SFT step=3150/4376 epoch=1.440 loss=0.4003 260601-06:55:28 (UTC+8)260601-06:55:29 (UTC+8)
449P1 SFT step=3140/4376 epoch=1.435 loss=0.4992 260601-06:53:02 (UTC+8)260601-06:53:04 (UTC+8)
448P1 SFT step=3130/4376 epoch=1.431 loss=0.4032 260601-06:50:28 (UTC+8)260601-06:50:30 (UTC+8)
447P1 SFT step=3120/4376 epoch=1.426 loss=0.4444 260601-06:47:55 (UTC+8)260601-06:47:56 (UTC+8)
446P1 SFT step=3110/4376 epoch=1.421 loss=0.4362 260601-06:45:22 (UTC+8)260601-06:45:24 (UTC+8)
445P1 SFT step=3100/4376 epoch=1.417 loss=0.4636 260601-06:42:53 (UTC+8)260601-06:42:54 (UTC+8)
444P1 SFT step=3090/4376 epoch=1.412 loss=0.5029 260601-06:40:18 (UTC+8)260601-06:40:20 (UTC+8)
443P1 SFT step=3080/4376 epoch=1.408 loss=0.4383 260601-06:37:44 (UTC+8)260601-06:37:45 (UTC+8)
442P1 SFT step=3070/4376 epoch=1.403 loss=0.3851 260601-06:35:07 (UTC+8)260601-06:35:12 (UTC+8)
441P1 SFT step=3060/4376 epoch=1.399 loss=0.4744 260601-06:32:40 (UTC+8)260601-06:32:42 (UTC+8)
440P1 SFT step=3050/4376 epoch=1.394 loss=0.3982 260601-06:30:06 (UTC+8)260601-06:30:08 (UTC+8)
439P1 SFT step=3040/4376 epoch=1.389 loss=0.4706 260601-06:27:32 (UTC+8)260601-06:27:33 (UTC+8)
438P1 SFT step=3030/4376 epoch=1.385 loss=0.4057 260601-06:24:56 (UTC+8)260601-06:24:58 (UTC+8)
437P1 SFT step=3020/4376 epoch=1.380 loss=0.5188 260601-06:22:24 (UTC+8)260601-06:22:25 (UTC+8)
436P1 SFT step=3010/4376 epoch=1.376 loss=0.3664 260601-06:19:43 (UTC+8)260601-06:19:44 (UTC+8)
435P1 SFT step=3000/4376 epoch=1.371 loss=0.5072 260601-06:17:14 (UTC+8)260601-06:17:15 (UTC+8)
434P1 SFT step=2990/4376 epoch=1.367 loss=0.4611 260601-06:14:41 (UTC+8)260601-06:14:42 (UTC+8)
433P1 SFT step=2980/4376 epoch=1.362 loss=0.4585 260601-06:12:13 (UTC+8)260601-06:12:14 (UTC+8)
432P1 SFT step=2970/4376 epoch=1.357 loss=0.4736 260601-06:09:39 (UTC+8)260601-06:09:40 (UTC+8)
431P1 SFT step=2960/4376 epoch=1.353 loss=0.4637 260601-06:07:06 (UTC+8)260601-06:07:08 (UTC+8)
430P1 SFT step=2950/4376 epoch=1.348 loss=0.4566 260601-06:04:28 (UTC+8)260601-06:04:29 (UTC+8)
429P1 SFT step=2940/4376 epoch=1.344 loss=0.4322 260601-06:01:53 (UTC+8)260601-06:01:55 (UTC+8)
428P1 SFT step=2930/4376 epoch=1.339 loss=0.4650 260601-05:59:21 (UTC+8)260601-05:59:22 (UTC+8)
427P1 SFT step=2920/4376 epoch=1.335 loss=0.4539 260601-05:56:46 (UTC+8)260601-05:56:47 (UTC+8)
426P1 SFT step=2910/4376 epoch=1.330 loss=0.5192 260601-05:54:11 (UTC+8)260601-05:54:12 (UTC+8)
425P1 SFT step=2900/4376 epoch=1.325 loss=0.4528 260601-05:51:30 (UTC+8)260601-05:51:32 (UTC+8)
424P1 SFT step=2890/4376 epoch=1.321 loss=0.4676 260601-05:48:52 (UTC+8)260601-05:48:54 (UTC+8)
423P1 SFT step=2880/4376 epoch=1.316 loss=0.4205 260601-05:46:18 (UTC+8)260601-05:46:19 (UTC+8)
422P1 SFT step=2870/4376 epoch=1.312 loss=0.4586 260601-05:43:48 (UTC+8)260601-05:43:49 (UTC+8)
421P1 SFT step=2860/4376 epoch=1.307 loss=0.4319 260601-05:41:11 (UTC+8)260601-05:41:11 (UTC+8)
420P1 SFT step=2850/4376 epoch=1.303 loss=0.5144 260601-05:38:36 (UTC+8)260601-05:38:38 (UTC+8)
419P1 SFT step=2840/4376 epoch=1.298 loss=0.4219 260601-05:36:03 (UTC+8)260601-05:36:04 (UTC+8)
418P1 SFT step=2830/4376 epoch=1.293 loss=0.5143 260601-05:33:35 (UTC+8)260601-05:33:36 (UTC+8)
417P1 SFT step=2820/4376 epoch=1.289 loss=0.5027 260601-05:30:55 (UTC+8)260601-05:30:55 (UTC+8)
416P1 SFT step=2810/4376 epoch=1.284 loss=0.5264 260601-05:28:20 (UTC+8)260601-05:28:21 (UTC+8)
415P1 SFT step=2800/4376 epoch=1.280 loss=0.4376 260601-05:25:45 (UTC+8)260601-05:25:45 (UTC+8)
414P1 SFT step=2790/4376 epoch=1.275 loss=0.5239 260601-05:23:08 (UTC+8)260601-05:23:11 (UTC+8)
413P1 SFT step=2780/4376 epoch=1.271 loss=0.5284 260601-05:20:36 (UTC+8)260601-05:20:37 (UTC+8)
412P1 SFT step=2770/4376 epoch=1.266 loss=0.4476 260601-05:18:00 (UTC+8)260601-05:18:01 (UTC+8)
411P1 SFT step=2760/4376 epoch=1.261 loss=0.4698 260601-05:15:29 (UTC+8)260601-05:15:30 (UTC+8)
410P1 SFT step=2750/4376 epoch=1.257 loss=0.4815 260601-05:12:57 (UTC+8)260601-05:12:58 (UTC+8)
409P1 SFT step=2740/4376 epoch=1.252 loss=0.4984 260601-05:10:33 (UTC+8)260601-05:10:34 (UTC+8)
408P1 SFT step=2730/4376 epoch=1.248 loss=0.4950 260601-05:07:55 (UTC+8)260601-05:07:57 (UTC+8)
407P1 SFT step=2720/4376 epoch=1.243 loss=0.4782 260601-05:05:17 (UTC+8)260601-05:05:19 (UTC+8)
406P1 SFT step=2700/4376 epoch=1.234 loss=0.5262 260601-05:00:09 (UTC+8)260601-05:00:11 (UTC+8)
405P1 SFT step=2690/4376 epoch=1.229 loss=0.4967 260601-04:57:36 (UTC+8)260601-04:57:37 (UTC+8)
404P1 SFT step=2680/4376 epoch=1.225 loss=0.5120 260601-04:55:04 (UTC+8)260601-04:55:06 (UTC+8)
403P1 SFT step=2670/4376 epoch=1.220 loss=0.4842 260601-04:52:40 (UTC+8)260601-04:52:41 (UTC+8)
402P1 SFT step=2640/4376 epoch=1.207 loss=0.5172 260601-04:44:55 (UTC+8)260601-04:44:55 (UTC+8)
401P1 SFT step=2630/4376 epoch=1.202 loss=0.5156 260601-04:42:18 (UTC+8)260601-04:42:20 (UTC+8)
400P1 SFT step=2610/4376 epoch=1.193 loss=0.4850 260601-04:37:04 (UTC+8)260601-04:37:06 (UTC+8)
399P1 SFT step=2600/4376 epoch=1.188 loss=0.5134 260601-04:34:28 (UTC+8)260601-04:34:30 (UTC+8)
398P1 SFT step=2580/4376 epoch=1.179 loss=0.4846 260601-04:29:18 (UTC+8)260601-04:29:19 (UTC+8)
397P1 SFT step=2570/4376 epoch=1.175 loss=0.5051 260601-04:26:42 (UTC+8)260601-04:26:43 (UTC+8)
396P1 SFT step=2550/4376 epoch=1.165 loss=0.5088 260601-04:21:33 (UTC+8)260601-04:21:34 (UTC+8)
395P1 SFT step=2540/4376 epoch=1.161 loss=0.5719 260601-04:18:58 (UTC+8)260601-04:19:00 (UTC+8)
394P1 SFT step=2530/4376 epoch=1.156 loss=0.5359 260601-04:16:30 (UTC+8)260601-04:16:31 (UTC+8)
393P1 SFT step=2520/4376 epoch=1.152 loss=0.4653 260601-04:13:53 (UTC+8)260601-04:13:53 (UTC+8)
392P1 SFT step=2500/4376 epoch=1.143 loss=0.4832 260601-04:08:33 (UTC+8)260601-04:08:34 (UTC+8)
391P1 SFT step=2490/4376 epoch=1.138 loss=0.5342 260601-04:06:03 (UTC+8)260601-04:06:03 (UTC+8)
390P1 SFT step=2480/4376 epoch=1.133 loss=0.5635 260601-04:03:23 (UTC+8)260601-04:03:24 (UTC+8)
389P1 SFT step=2470/4376 epoch=1.129 loss=0.5621 260601-04:00:50 (UTC+8)260601-04:00:52 (UTC+8)
388P1 SFT step=2460/4376 epoch=1.124 loss=0.4997 260601-03:58:26 (UTC+8)260601-03:58:27 (UTC+8)
387P1 SFT step=2450/4376 epoch=1.120 loss=0.4847 260601-03:55:53 (UTC+8)260601-03:55:56 (UTC+8)
386P1 SFT step=2440/4376 epoch=1.115 loss=0.5683 260601-03:53:27 (UTC+8)260601-03:53:28 (UTC+8)
385P1 SFT step=2430/4376 epoch=1.111 loss=0.5099 260601-03:50:46 (UTC+8)260601-03:50:47 (UTC+8)
384P1 SFT step=2420/4376 epoch=1.106 loss=0.5514 260601-03:48:12 (UTC+8)260601-03:48:14 (UTC+8)
383P1 SFT step=2410/4376 epoch=1.101 loss=0.5028 260601-03:45:40 (UTC+8)260601-03:45:41 (UTC+8)
382P1 SFT step=2400/4376 epoch=1.097 loss=0.5509 260601-03:43:09 (UTC+8)260601-03:43:10 (UTC+8)
381P1 SFT step=2390/4376 epoch=1.092 loss=0.5280 260601-03:40:34 (UTC+8)260601-03:40:36 (UTC+8)
380P1 SFT step=2380/4376 epoch=1.088 loss=0.5336 260601-03:38:02 (UTC+8)260601-03:38:04 (UTC+8)
379P1 SFT step=2360/4376 epoch=1.079 loss=0.5466 260601-03:32:44 (UTC+8)260601-03:32:48 (UTC+8)
378P1 SFT step=2350/4376 epoch=1.074 loss=0.5451 260601-03:30:13 (UTC+8)260601-03:30:14 (UTC+8)
377P1 SFT step=2340/4376 epoch=1.069 loss=0.5258 260601-03:27:35 (UTC+8)260601-03:27:37 (UTC+8)
376P1 SFT step=2330/4376 epoch=1.065 loss=0.5667 260601-03:25:00 (UTC+8)260601-03:25:01 (UTC+8)
375P1 SFT step=2320/4376 epoch=1.060 loss=0.4991 260601-03:22:36 (UTC+8)260601-03:22:37 (UTC+8)
374P1 SFT step=2310/4376 epoch=1.056 loss=0.5877 260601-03:20:05 (UTC+8)260601-03:20:07 (UTC+8)
373P1 SFT step=2300/4376 epoch=1.051 loss=0.5443 260601-03:17:36 (UTC+8)260601-03:17:37 (UTC+8)
372P1 SFT step=2290/4376 epoch=1.047 loss=0.5224 260601-03:15:02 (UTC+8)260601-03:15:03 (UTC+8)
371P1 SFT step=2280/4376 epoch=1.042 loss=0.5524 260601-03:12:34 (UTC+8)260601-03:12:35 (UTC+8)
370P1 SFT step=2270/4376 epoch=1.037 loss=0.5437 260601-03:10:06 (UTC+8)260601-03:10:08 (UTC+8)
369P1 SFT step=2260/4376 epoch=1.033 loss=0.5874 260601-03:07:35 (UTC+8)260601-03:07:36 (UTC+8)
368P1 SFT step=2240/4376 epoch=1.024 loss=0.4508 260601-03:02:24 (UTC+8)260601-03:02:25 (UTC+8)
367P1 SFT step=2230/4376 epoch=1.019 loss=0.5237 260601-02:59:59 (UTC+8)260601-03:00:01 (UTC+8)
366P1 SFT step=2220/4376 epoch=1.015 loss=0.5522 260601-02:57:29 (UTC+8)260601-02:57:30 (UTC+8)
365P1 SFT step=2210/4376 epoch=1.010 loss=0.5394 260601-02:54:57 (UTC+8)260601-02:54:57 (UTC+8)
364P1 SFT step=2200/4376 epoch=1.005 loss=0.5419 260601-02:52:28 (UTC+8)260601-02:52:30 (UTC+8)
363P1 SFT step=2190/4376 epoch=1.001 loss=0.7049 260601-02:49:56 (UTC+8)260601-02:49:56 (UTC+8)
362P1 SFT checkpoint:step=2188 epoch=1.000 260601-02:49:17 (UTC+8)260601-02:49:19 (UTC+8)
361P1 SFT step=2180/4376 epoch=0.997 loss=0.6906 260601-02:47:23 (UTC+8)260601-02:47:24 (UTC+8)
360P1 SFT step=2170/4376 epoch=0.992 loss=0.7022 260601-02:44:47 (UTC+8)260601-02:44:48 (UTC+8)
359P1 SFT step=2160/4376 epoch=0.987 loss=0.6622 260601-02:42:20 (UTC+8)260601-02:42:21 (UTC+8)
358P1 SFT step=2150/4376 epoch=0.983 loss=0.6409 260601-02:39:42 (UTC+8)260601-02:39:43 (UTC+8)
357P1 SFT step=2140/4376 epoch=0.978 loss=0.6175 260601-02:37:14 (UTC+8)260601-02:37:14 (UTC+8)
356P1 SFT step=2120/4376 epoch=0.969 loss=0.5839 260601-02:32:10 (UTC+8)260601-02:32:11 (UTC+8)
355P1 SFT step=2110/4376 epoch=0.965 loss=0.6475 260601-02:29:35 (UTC+8)260601-02:29:37 (UTC+8)
354P1 SFT step=2100/4376 epoch=0.960 loss=0.6699 260601-02:27:04 (UTC+8)260601-02:27:05 (UTC+8)
353P1 SFT step=2090/4376 epoch=0.955 loss=0.6165 260601-02:24:34 (UTC+8)260601-02:24:34 (UTC+8)
352P1 SFT step=2080/4376 epoch=0.951 loss=0.5562 260601-02:22:03 (UTC+8)260601-02:22:05 (UTC+8)
351P1 SFT step=2070/4376 epoch=0.946 loss=0.6663 260601-02:19:32 (UTC+8)260601-02:19:33 (UTC+8)
350P1 SFT step=2060/4376 epoch=0.942 loss=0.6188 260601-02:16:56 (UTC+8)260601-02:16:57 (UTC+8)
349P1 SFT step=2050/4376 epoch=0.937 loss=0.6773 260601-02:13:21 (UTC+8)260601-02:14:29 (UTC+8)
348P1 SFT step=2030/4376 epoch=0.928 loss=0.6350 260601-02:08:23 (UTC+8)260601-02:09:20 (UTC+8)
347P1 SFT step=2020/4376 epoch=0.923 loss=0.7260 260601-02:05:56 (UTC+8)260601-02:06:46 (UTC+8)
346P1 SFT step=2010/4376 epoch=0.919 loss=0.7019 260601-02:03:23 (UTC+8)260601-02:04:07 (UTC+8)
345P1 SFT step=2000/4376 epoch=0.914 loss=0.6530 260601-02:00:54 (UTC+8)260601-02:01:32 (UTC+8)
344P1 SFT step=1990/4376 epoch=0.910 loss=0.7009 260601-01:58:24 (UTC+8)260601-01:58:55 (UTC+8)
343P1 SFT step=1980/4376 epoch=0.905 loss=0.7092 260601-01:55:49 (UTC+8)260601-01:56:14 (UTC+8)
342P1 SFT step=1970/4376 epoch=0.901 loss=0.7338 260601-01:53:21 (UTC+8)260601-01:53:40 (UTC+8)
341P1 SFT step=1960/4376 epoch=0.896 loss=0.6442 260601-01:50:55 (UTC+8)260601-01:51:08 (UTC+8)
340P1 SFT step=1950/4376 epoch=0.891 loss=0.8162 260601-01:48:32 (UTC+8)260601-01:48:38 (UTC+8)
339P1 SFT step=1940/4376 epoch=0.887 loss=0.7661 260601-01:46:00 (UTC+8)260601-01:46:02 (UTC+8)
338P1 SFT step=1920/4376 epoch=0.878 loss=0.7132 260601-01:40:46 (UTC+8)260601-01:40:47 (UTC+8)
337P1 SFT step=1910/4376 epoch=0.873 loss=0.6735 260601-01:38:10 (UTC+8)260601-01:38:10 (UTC+8)
336P1 SFT step=1900/4376 epoch=0.869 loss=0.6356 260601-01:35:33 (UTC+8)260601-01:35:35 (UTC+8)
335P1 SFT step=1890/4376 epoch=0.864 loss=0.7646 260601-01:33:00 (UTC+8)260601-01:33:01 (UTC+8)
334P1 SFT step=1880/4376 epoch=0.859 loss=0.6741 260601-01:30:19 (UTC+8)260601-01:30:20 (UTC+8)
333P1 SFT step=1870/4376 epoch=0.855 loss=0.7509 260601-01:27:43 (UTC+8)260601-01:27:44 (UTC+8)
332P1 SFT step=1860/4376 epoch=0.850 loss=0.7003 260601-01:25:08 (UTC+8)260601-01:25:10 (UTC+8)
331P1 SFT step=1850/4376 epoch=0.846 loss=0.6384 260601-01:22:38 (UTC+8)260601-01:22:39 (UTC+8)
330P1 SFT step=1840/4376 epoch=0.841 loss=0.7289 260601-01:20:03 (UTC+8)260601-01:20:06 (UTC+8)
329P1 SFT step=1830/4376 epoch=0.837 loss=0.7142 260601-01:17:34 (UTC+8)260601-01:17:35 (UTC+8)
328P1 SFT step=1820/4376 epoch=0.832 loss=0.6864 260601-01:14:55 (UTC+8)260601-01:14:58 (UTC+8)
327P1 SFT step=1810/4376 epoch=0.827 loss=0.7249 260601-01:12:26 (UTC+8)260601-01:12:27 (UTC+8)
326P1 SFT step=1780/4376 epoch=0.814 loss=0.7342 260601-01:04:36 (UTC+8)260601-01:04:39 (UTC+8)
325P1 SFT step=1770/4376 epoch=0.809 loss=0.7407 260601-01:02:03 (UTC+8)260601-01:02:03 (UTC+8)
324P1 SFT step=1760/4376 epoch=0.805 loss=0.6541 260601-00:59:27 (UTC+8)260601-00:59:28 (UTC+8)
323P1 SFT step=1750/4376 epoch=0.800 loss=0.7168 260601-00:56:50 (UTC+8)260601-00:56:52 (UTC+8)
322P1 SFT step=1740/4376 epoch=0.795 loss=0.7514 260601-00:54:10 (UTC+8)260601-00:54:10 (UTC+8)
321P1 SFT step=1720/4376 epoch=0.786 loss=0.6733 260601-00:49:05 (UTC+8)260601-00:49:06 (UTC+8)
320P1 SFT step=1710/4376 epoch=0.782 loss=0.7828 260601-00:46:37 (UTC+8)260601-00:46:38 (UTC+8)
319P1 SFT step=1690/4376 epoch=0.773 loss=0.7162 260601-00:41:32 (UTC+8)260601-00:41:35 (UTC+8)
318P1 SFT step=1680/4376 epoch=0.768 loss=0.7670 260601-00:39:04 (UTC+8)260601-00:39:06 (UTC+8)
317P1 SFT step=1670/4376 epoch=0.763 loss=0.7357 260601-00:36:29 (UTC+8)260601-00:36:30 (UTC+8)
316P1 SFT step=1660/4376 epoch=0.759 loss=0.8463 260601-00:33:58 (UTC+8)260601-00:34:00 (UTC+8)
315P1 SFT step=1650/4376 epoch=0.754 loss=0.6875 260601-00:31:27 (UTC+8)260601-00:31:28 (UTC+8)
314P1 SFT step=1640/4376 epoch=0.750 loss=0.6803 260601-00:28:57 (UTC+8)260601-00:28:59 (UTC+8)
313P1 SFT step=1630/4376 epoch=0.745 loss=0.7272 260601-00:26:23 (UTC+8)260601-00:26:24 (UTC+8)
312P1 SFT step=1620/4376 epoch=0.741 loss=0.8005 260601-00:23:52 (UTC+8)260601-00:23:55 (UTC+8)
311P1 SFT step=1610/4376 epoch=0.736 loss=0.7313 260601-00:21:16 (UTC+8)260601-00:21:17 (UTC+8)
310P1 SFT step=1600/4376 epoch=0.731 loss=0.7984 260601-00:18:38 (UTC+8)260601-00:18:39 (UTC+8)
309P1 SFT step=1590/4376 epoch=0.727 loss=0.8233 260601-00:16:03 (UTC+8)260601-00:16:05 (UTC+8)
308P1 SFT step=1570/4376 epoch=0.718 loss=0.8731 260601-00:09:47 (UTC+8)260601-00:10:53 (UTC+8)
307P1 SFT step=1560/4376 epoch=0.713 loss=0.7466 260601-00:07:16 (UTC+8)260601-00:08:16 (UTC+8)
306P1 SFT step=1550/4376 epoch=0.709 loss=0.7316 260601-00:04:44 (UTC+8)260601-00:05:37 (UTC+8)
305P1 SFT step=1540/4376 epoch=0.704 loss=0.8193 260601-00:02:18 (UTC+8)260601-00:03:05 (UTC+8)
304P1 SFT step=1530/4376 epoch=0.699 loss=0.8206 260531-23:59:54 (UTC+8)260601-00:00:35 (UTC+8)
303P1 SFT step=1520/4376 epoch=0.695 loss=0.8369 260531-23:57:20 (UTC+8)260531-23:57:55 (UTC+8)
302P1 SFT step=1510/4376 epoch=0.690 loss=0.7072 260531-23:54:53 (UTC+8)260531-23:55:22 (UTC+8)
301P1 SFT step=1500/4376 epoch=0.686 loss=0.7748 260531-23:52:33 (UTC+8)260531-23:52:56 (UTC+8)
300P1 SFT step=1490/4376 epoch=0.681 loss=0.7755 260531-23:50:04 (UTC+8)260531-23:50:21 (UTC+8)
299P1 SFT step=1470/4376 epoch=0.672 loss=0.7651 260531-23:45:11 (UTC+8)260531-23:45:16 (UTC+8)
298P1 SFT step=1440/4376 epoch=0.658 loss=0.7756 260531-23:37:23 (UTC+8)260531-23:37:25 (UTC+8)
297P1 SFT step=1430/4376 epoch=0.654 loss=0.8530 260531-23:34:50 (UTC+8)260531-23:34:51 (UTC+8)
296P1 SFT step=1420/4376 epoch=0.649 loss=0.7853 260531-23:32:23 (UTC+8)260531-23:32:25 (UTC+8)
295P1 SFT step=1410/4376 epoch=0.645 loss=0.8593 260531-23:29:53 (UTC+8)260531-23:29:54 (UTC+8)
294P1 SFT step=1380/4376 epoch=0.631 loss=0.8109 260531-23:22:02 (UTC+8)260531-23:22:17 (UTC+8)
293P1 SFT step=1350/4376 epoch=0.617 loss=0.8325 260531-23:14:30 (UTC+8)260531-23:14:31 (UTC+8)
292P1 SFT step=1340/4376 epoch=0.613 loss=0.8302 260531-23:11:59 (UTC+8)260531-23:12:00 (UTC+8)
291P1 SFT step=1330/4376 epoch=0.608 loss=0.7975 260531-23:09:27 (UTC+8)260531-23:09:28 (UTC+8)
290P1 SFT step=1320/4376 epoch=0.603 loss=0.8237 260531-23:06:55 (UTC+8)260531-23:06:56 (UTC+8)
289P1 SFT step=1310/4376 epoch=0.599 loss=0.8990 260531-23:04:18 (UTC+8)260531-23:04:19 (UTC+8)
288P1 SFT step=1300/4376 epoch=0.594 loss=0.8892 260531-23:01:47 (UTC+8)260531-23:01:48 (UTC+8)
287P1 SFT step=1290/4376 epoch=0.590 loss=0.8164 260531-22:59:09 (UTC+8)260531-22:59:10 (UTC+8)
286P1 SFT step=1280/4376 epoch=0.585 loss=0.8290 260531-22:56:36 (UTC+8)260531-22:56:38 (UTC+8)
285P1 SFT step=1270/4376 epoch=0.581 loss=0.9169 260531-22:54:11 (UTC+8)260531-22:54:12 (UTC+8)
284P1 SFT step=1260/4376 epoch=0.576 loss=0.8885 260531-22:51:42 (UTC+8)260531-22:51:42 (UTC+8)
283P1 SFT step=1250/4376 epoch=0.571 loss=0.9184 260531-22:49:08 (UTC+8)260531-22:49:10 (UTC+8)
282P1 SFT step=1230/4376 epoch=0.562 loss=0.8297 260531-22:44:01 (UTC+8)260531-22:44:02 (UTC+8)
281P1 SFT step=1220/4376 epoch=0.558 loss=0.9293 260531-22:41:28 (UTC+8)260531-22:41:29 (UTC+8)
280P1 SFT step=1210/4376 epoch=0.553 loss=0.8901 260531-22:38:56 (UTC+8)260531-22:38:57 (UTC+8)
279P1 SFT step=1200/4376 epoch=0.549 loss=0.9213 260531-22:36:25 (UTC+8)260531-22:36:27 (UTC+8)
278P1 SFT step=1170/4376 epoch=0.535 loss=0.9128 260531-22:28:30 (UTC+8)260531-22:28:32 (UTC+8)
277P1 SFT step=1160/4376 epoch=0.530 loss=0.9370 260531-22:25:52 (UTC+8)260531-22:25:53 (UTC+8)
276P1 SFT step=1150/4376 epoch=0.526 loss=0.8777 260531-22:23:19 (UTC+8)260531-22:23:21 (UTC+8)
275P1 SFT step=1140/4376 epoch=0.521 loss=0.8493 260531-22:20:47 (UTC+8)260531-22:20:48 (UTC+8)
274P1 SFT step=1130/4376 epoch=0.517 loss=0.9141 260531-22:18:17 (UTC+8)260531-22:18:18 (UTC+8)
273P1 SFT step=1120/4376 epoch=0.512 loss=0.9630 260531-22:15:40 (UTC+8)260531-22:15:41 (UTC+8)
272P1 SFT step=1110/4376 epoch=0.507 loss=0.9999 260531-22:13:10 (UTC+8)260531-22:13:11 (UTC+8)
271P1 SFT step=1090/4376 epoch=0.498 loss=0.9376 260531-22:08:01 (UTC+8)260531-22:08:02 (UTC+8)
270P1 SFT step=1080/4376 epoch=0.494 loss=0.9456 260531-22:05:27 (UTC+8)260531-22:05:29 (UTC+8)
269P1 SFT step=1070/4376 epoch=0.489 loss=0.9690 260531-22:02:51 (UTC+8)260531-22:02:52 (UTC+8)
268P1 SFT step=1060/4376 epoch=0.485 loss=0.9449 260531-22:00:12 (UTC+8)260531-22:00:12 (UTC+8)
267P1 SFT step=1050/4376 epoch=0.480 loss=0.9508 260531-21:57:43 (UTC+8)260531-21:57:45 (UTC+8)
266P1 SFT step=1040/4376 epoch=0.475 loss=0.9140 260531-21:55:11 (UTC+8)260531-21:55:12 (UTC+8)
265P1 SFT step=1030/4376 epoch=0.471 loss=0.8981 260531-21:52:45 (UTC+8)260531-21:52:46 (UTC+8)
264P1 SFT step=1020/4376 epoch=0.466 loss=0.9857 260531-21:50:13 (UTC+8)260531-21:50:14 (UTC+8)
263P1 SFT step=1000/4376 epoch=0.457 loss=0.9629 260531-21:44:51 (UTC+8)260531-21:44:52 (UTC+8)
262P1 SFT step=980/4376 epoch=0.448 loss=0.9765 260531-21:39:37 (UTC+8)260531-21:39:38 (UTC+8)
261P1 SFT step=970/4376 epoch=0.443 loss=1.0481 260531-21:37:08 (UTC+8)260531-21:37:09 (UTC+8)
260P1 SFT step=960/4376 epoch=0.439 loss=0.9971 260531-21:34:35 (UTC+8)260531-21:34:36 (UTC+8)
259P1 SFT step=950/4376 epoch=0.434 loss=0.9245 260531-21:32:03 (UTC+8)260531-21:32:03 (UTC+8)
258P1 SFT step=940/4376 epoch=0.430 loss=0.9599 260531-21:29:27 (UTC+8)260531-21:29:29 (UTC+8)
257P1 SFT step=930/4376 epoch=0.425 loss=1.0075 260531-21:27:00 (UTC+8)260531-21:27:01 (UTC+8)
256P1 SFT step=920/4376 epoch=0.421 loss=0.9896 260531-21:24:23 (UTC+8)260531-21:24:25 (UTC+8)
255P1 SFT step=910/4376 epoch=0.416 loss=1.0087 260531-21:21:51 (UTC+8)260531-21:21:52 (UTC+8)
254P1 SFT step=900/4376 epoch=0.411 loss=1.0087 260531-21:19:18 (UTC+8)260531-21:19:19 (UTC+8)
253P1 SFT step=890/4376 epoch=0.407 loss=0.9793 260531-21:16:44 (UTC+8)260531-21:16:46 (UTC+8)
252P1 SFT step=880/4376 epoch=0.402 loss=1.0571 260531-21:14:20 (UTC+8)260531-21:14:21 (UTC+8)
251P1 SFT step=870/4376 epoch=0.398 loss=1.0086 260531-21:11:49 (UTC+8)260531-21:11:50 (UTC+8)
250P1 SFT step=840/4376 epoch=0.384 loss=0.9836 260531-21:04:04 (UTC+8)260531-21:04:05 (UTC+8)
249P1 SFT step=820/4376 epoch=0.375 loss=1.0462 260531-20:59:02 (UTC+8)260531-20:59:03 (UTC+8)
248P1 SFT step=810/4376 epoch=0.370 loss=1.0152 260531-20:56:23 (UTC+8)260531-20:56:24 (UTC+8)
247P1 SFT step=800/4376 epoch=0.366 loss=1.1583 260531-20:53:52 (UTC+8)260531-20:53:53 (UTC+8)
246P1 SFT step=780/4376 epoch=0.357 loss=1.1212 260531-20:48:39 (UTC+8)260531-20:48:40 (UTC+8)
245P1 SFT step=770/4376 epoch=0.352 loss=1.1320 260531-20:46:03 (UTC+8)260531-20:46:05 (UTC+8)
244P1 SFT step=760/4376 epoch=0.347 loss=1.2454 260531-20:43:31 (UTC+8)260531-20:43:33 (UTC+8)
243P1 SFT step=750/4376 epoch=0.343 loss=1.0907 260531-20:41:01 (UTC+8)260531-20:41:02 (UTC+8)
242P1 SFT step=740/4376 epoch=0.338 loss=1.0658 260531-20:38:25 (UTC+8)260531-20:38:27 (UTC+8)
241P1 SFT step=730/4376 epoch=0.334 loss=1.1370 260531-20:35:52 (UTC+8)260531-20:35:54 (UTC+8)
240P1 SFT step=710/4376 epoch=0.325 loss=1.1532 260531-20:30:48 (UTC+8)260531-20:30:48 (UTC+8)
239P1 SFT step=700/4376 epoch=0.320 loss=1.1271 260531-20:28:15 (UTC+8)260531-20:28:18 (UTC+8)
238P1 SFT step=690/4376 epoch=0.315 loss=1.1655 260531-20:25:38 (UTC+8)260531-20:25:39 (UTC+8)
237P1 SFT step=680/4376 epoch=0.311 loss=1.1886 260531-20:23:03 (UTC+8)260531-20:23:05 (UTC+8)
236P1 SFT step=670/4376 epoch=0.306 loss=1.1136 260531-20:20:31 (UTC+8)260531-20:20:33 (UTC+8)
235P1 SFT step=660/4376 epoch=0.302 loss=1.2503 260531-20:17:54 (UTC+8)260531-20:17:56 (UTC+8)
234P1 SFT step=650/4376 epoch=0.297 loss=1.1127 260531-20:15:24 (UTC+8)260531-20:15:25 (UTC+8)
233P1 SFT step=640/4376 epoch=0.293 loss=1.2197 260531-20:12:44 (UTC+8)260531-20:12:45 (UTC+8)
232P1 SFT step=630/4376 epoch=0.288 loss=1.1354 260531-20:10:15 (UTC+8)260531-20:10:16 (UTC+8)
231P1 SFT step=620/4376 epoch=0.283 loss=1.2540 260531-20:07:44 (UTC+8)260531-20:07:46 (UTC+8)
230P1 SFT step=610/4376 epoch=0.279 loss=1.0912 260531-20:05:10 (UTC+8)260531-20:05:11 (UTC+8)
229P1 SFT step=600/4376 epoch=0.274 loss=1.2642 260531-20:02:44 (UTC+8)260531-20:02:46 (UTC+8)
228P1 SFT step=590/4376 epoch=0.270 loss=1.1802 260531-20:00:12 (UTC+8)260531-20:00:13 (UTC+8)
227P1 SFT step=580/4376 epoch=0.265 loss=1.2785 260531-19:57:39 (UTC+8)260531-19:57:42 (UTC+8)
226P1 SFT step=570/4376 epoch=0.261 loss=1.2422 260531-19:55:17 (UTC+8)260531-19:55:17 (UTC+8)
225P1 SFT step=560/4376 epoch=0.256 loss=1.1844 260531-19:52:42 (UTC+8)260531-19:52:43 (UTC+8)
224P1 SFT step=540/4376 epoch=0.247 loss=1.2749 260531-19:47:25 (UTC+8)260531-19:47:26 (UTC+8)
223P1 SFT step=530/4376 epoch=0.242 loss=1.2587 260531-19:44:48 (UTC+8)260531-19:44:50 (UTC+8)
222P1 SFT step=520/4376 epoch=0.238 loss=1.2913 260531-19:42:17 (UTC+8)260531-19:42:20 (UTC+8)
221P1 SFT step=510/4376 epoch=0.233 loss=1.3365 260531-19:39:42 (UTC+8)260531-19:39:43 (UTC+8)
220P1 SFT step=490/4376 epoch=0.224 loss=1.2693 260531-19:34:25 (UTC+8)260531-19:34:26 (UTC+8)
219P1 SFT step=480/4376 epoch=0.219 loss=1.3089 260531-19:31:53 (UTC+8)260531-19:31:53 (UTC+8)
218P1 SFT step=470/4376 epoch=0.215 loss=1.4503 260531-19:29:16 (UTC+8)260531-19:29:17 (UTC+8)
217P1 SFT step=460/4376 epoch=0.210 loss=1.2228 260531-19:26:38 (UTC+8)260531-19:26:40 (UTC+8)
216P1 SFT step=450/4376 epoch=0.206 loss=1.4014 260531-19:24:03 (UTC+8)260531-19:24:04 (UTC+8)
215P1 SFT step=440/4376 epoch=0.201 loss=1.3414 260531-19:21:24 (UTC+8)260531-19:21:26 (UTC+8)
214P1 SFT step=430/4376 epoch=0.197 loss=1.3974 260531-19:18:51 (UTC+8)260531-19:18:52 (UTC+8)
213P1 SFT step=420/4376 epoch=0.192 loss=1.3520 260531-19:16:15 (UTC+8)260531-19:16:17 (UTC+8)
212P1 SFT step=410/4376 epoch=0.187 loss=1.3848 260531-19:13:40 (UTC+8)260531-19:13:41 (UTC+8)
211P1 SFT step=400/4376 epoch=0.183 loss=1.3448 260531-19:11:03 (UTC+8)260531-19:11:05 (UTC+8)
210P1 SFT step=390/4376 epoch=0.178 loss=1.4685 260531-19:08:29 (UTC+8)260531-19:08:30 (UTC+8)
209P1 SFT step=380/4376 epoch=0.174 loss=1.4094 260531-19:06:01 (UTC+8)260531-19:06:03 (UTC+8)
208P1 SFT step=370/4376 epoch=0.169 loss=1.4435 260531-19:03:30 (UTC+8)260531-19:03:32 (UTC+8)
207P1 SFT step=360/4376 epoch=0.165 loss=1.5099 260531-19:00:56 (UTC+8)260531-19:00:57 (UTC+8)
206P1 SFT step=350/4376 epoch=0.160 loss=1.4367 260531-18:58:17 (UTC+8)260531-18:58:18 (UTC+8)
205P1 SFT step=340/4376 epoch=0.155 loss=1.4798 260531-18:55:46 (UTC+8)260531-18:55:47 (UTC+8)
204P1 SFT step=330/4376 epoch=0.151 loss=1.5251 260531-18:53:14 (UTC+8)260531-18:53:15 (UTC+8)
203P1 SFT step=320/4376 epoch=0.146 loss=1.6086 260531-18:50:33 (UTC+8)260531-18:50:36 (UTC+8)
202P1 SFT step=310/4376 epoch=0.142 loss=1.7067 260531-18:48:04 (UTC+8)260531-18:48:05 (UTC+8)
201P1 SFT step=300/4376 epoch=0.137 loss=1.5104 260531-18:45:28 (UTC+8)260531-18:45:32 (UTC+8)
200P1 SFT step=290/4376 epoch=0.133 loss=1.4968 260531-18:42:58 (UTC+8)260531-18:42:59 (UTC+8)
199P1 SFT step=280/4376 epoch=0.128 loss=1.7255 260531-18:40:28 (UTC+8)260531-18:40:30 (UTC+8)
198P1 SFT step=270/4376 epoch=0.123 loss=1.6628 260531-18:37:54 (UTC+8)260531-18:37:55 (UTC+8)
197P1 SFT step=250/4376 epoch=0.114 loss=1.7136 260531-18:32:54 (UTC+8)260531-18:32:54 (UTC+8)
196P1 SFT step=240/4376 epoch=0.110 loss=1.6771 260531-18:30:20 (UTC+8)260531-18:30:22 (UTC+8)
195P1 SFT step=220/4376 epoch=0.101 loss=1.7953 260531-18:25:06 (UTC+8)260531-18:25:07 (UTC+8)
194P1 SFT step=200/4376 epoch=0.091 loss=1.9469 260531-18:19:51 (UTC+8)260531-18:19:53 (UTC+8)
193P1 SFT step=190/4376 epoch=0.087 loss=1.9246 260531-18:17:15 (UTC+8)260531-18:17:16 (UTC+8)
192P1 SFT step=170/4376 epoch=0.078 loss=1.9946 260531-18:11:51 (UTC+8)260531-18:11:53 (UTC+8)
191P1 SFT step=160/4376 epoch=0.073 loss=2.0109 260531-18:09:18 (UTC+8)260531-18:09:20 (UTC+8)
190P1 SFT step=150/4376 epoch=0.069 loss=2.0791 260531-18:06:52 (UTC+8)260531-18:06:54 (UTC+8)
189P1 SFT step=140/4376 epoch=0.064 loss=2.1571 260531-18:04:21 (UTC+8)260531-18:04:21 (UTC+8)
188P1 SFT step=130/4376 epoch=0.059 loss=2.2260 260531-18:01:53 (UTC+8)260531-18:01:54 (UTC+8)
187P1 SFT step=110/4376 epoch=0.050 loss=2.3585 260531-17:56:49 (UTC+8)260531-17:56:49 (UTC+8)
186P1 SFT step=100/4376 epoch=0.046 loss=2.4429 260531-17:54:19 (UTC+8)260531-17:54:21 (UTC+8)
185P1 SFT step=80/4376 epoch=0.037 loss=2.5792 260531-17:49:05 (UTC+8)260531-17:49:07 (UTC+8)
184P1 SFT step=50/4376 epoch=0.023 loss=2.9241 260531-17:41:23 (UTC+8)260531-17:41:24 (UTC+8)
183P1 SFT step=40/4376 epoch=0.018 loss=3.0562 260531-17:38:51 (UTC+8)260531-17:38:53 (UTC+8)
182P1 SFT step=30/4376 epoch=0.014 loss=3.3014 260531-17:36:21 (UTC+8)260531-17:36:22 (UTC+8)
181P1 SFT step=20/4376 epoch=0.009 loss=3.5414 260531-17:33:47 (UTC+8)260531-17:33:48 (UTC+8)
180P1 SFT step=10/4376 epoch=0.005 loss=3.7260 260531-17:31:17 (UTC+8)260531-17:31:18 (UTC+8)
179P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260531-17:26:18 (UTC+8)260531-17:26:19 (UTC+8)
178启动核心实验:P1 260531-17:26:07 (UTC+8)260531-17:26:08 (UTC+8)
177run.py 正常启动:device=cuda:0 n_trials=40 start_at=P1 sft_prompts=35000 bank_prompts=35000 | 顺序=P0 tokenized raw embedding -> P1 LLM SFT -> P2 SFT/P4格式审计 -> P4 SFT hidden bank -> P3 sanity -> P5 Optuna 260531-17:26:06 (UTC+8)260531-17:26:08 (UTC+8)
176P1 SFT step=1420/4376 epoch=0.649 loss=0.7816 260531-17:19:20 (UTC+8)260531-17:19:21 (UTC+8)
175P1 SFT step=1410/4376 epoch=0.645 loss=0.8592 260531-17:16:49 (UTC+8)260531-17:16:50 (UTC+8)
174P1 SFT step=1400/4376 epoch=0.640 loss=0.8642 260531-17:14:17 (UTC+8)260531-17:14:18 (UTC+8)
173P1 SFT step=1380/4376 epoch=0.631 loss=0.8099 260531-17:09:17 (UTC+8)260531-17:09:18 (UTC+8)
172P1 SFT step=1370/4376 epoch=0.626 loss=0.8802 260531-17:06:48 (UTC+8)260531-17:06:49 (UTC+8)
171P1 SFT step=1360/4376 epoch=0.622 loss=0.8016 260531-17:04:13 (UTC+8)260531-17:04:16 (UTC+8)
170P1 SFT step=1350/4376 epoch=0.617 loss=0.8314 260531-17:01:39 (UTC+8)260531-17:01:40 (UTC+8)
169P1 SFT step=1340/4376 epoch=0.613 loss=0.8295 260531-16:59:07 (UTC+8)260531-16:59:09 (UTC+8)
168P1 SFT step=1330/4376 epoch=0.608 loss=0.7956 260531-16:56:36 (UTC+8)260531-16:56:37 (UTC+8)
167P1 SFT step=1320/4376 epoch=0.603 loss=0.8232 260531-16:54:04 (UTC+8)260531-16:54:05 (UTC+8)
166P1 SFT step=1310/4376 epoch=0.599 loss=0.8978 260531-16:51:26 (UTC+8)260531-16:51:28 (UTC+8)
165P1 SFT step=1290/4376 epoch=0.590 loss=0.8183 260531-16:46:14 (UTC+8)260531-16:46:15 (UTC+8)
164P1 SFT step=1280/4376 epoch=0.585 loss=0.8297 260531-16:43:40 (UTC+8)260531-16:43:41 (UTC+8)
163P1 SFT step=1270/4376 epoch=0.581 loss=0.9192 260531-16:41:15 (UTC+8)260531-16:41:16 (UTC+8)
162P1 SFT step=1260/4376 epoch=0.576 loss=0.8902 260531-16:38:44 (UTC+8)260531-16:38:46 (UTC+8)
161P1 SFT step=1250/4376 epoch=0.571 loss=0.9182 260531-16:36:12 (UTC+8)260531-16:36:13 (UTC+8)
160P1 SFT step=1240/4376 epoch=0.567 loss=0.8468 260531-16:33:41 (UTC+8)260531-16:33:43 (UTC+8)
159P1 SFT step=1230/4376 epoch=0.562 loss=0.8291 260531-16:31:08 (UTC+8)260531-16:31:10 (UTC+8)
158P1 SFT step=1220/4376 epoch=0.558 loss=0.9293 260531-16:28:32 (UTC+8)260531-16:28:36 (UTC+8)
157P1 SFT step=1210/4376 epoch=0.553 loss=0.8928 260531-16:26:02 (UTC+8)260531-16:26:03 (UTC+8)
156P1 SFT step=1200/4376 epoch=0.549 loss=0.9204 260531-16:23:31 (UTC+8)260531-16:23:33 (UTC+8)
155P1 SFT step=1190/4376 epoch=0.544 loss=0.8869 260531-16:20:57 (UTC+8)260531-16:20:58 (UTC+8)
154P1 SFT step=1180/4376 epoch=0.539 loss=0.8896 260531-16:18:17 (UTC+8)260531-16:18:18 (UTC+8)
153P1 SFT step=1170/4376 epoch=0.535 loss=0.9129 260531-16:15:46 (UTC+8)260531-16:15:47 (UTC+8)
152P1 SFT step=1160/4376 epoch=0.530 loss=0.9356 260531-16:13:06 (UTC+8)260531-16:13:07 (UTC+8)
151P1 SFT step=1150/4376 epoch=0.526 loss=0.8760 260531-16:10:34 (UTC+8)260531-16:10:35 (UTC+8)
150P1 SFT step=1140/4376 epoch=0.521 loss=0.8494 260531-16:08:01 (UTC+8)260531-16:08:02 (UTC+8)
149P1 SFT step=1130/4376 epoch=0.517 loss=0.9110 260531-16:05:31 (UTC+8)260531-16:05:32 (UTC+8)
148P1 SFT step=1110/4376 epoch=0.507 loss=0.9980 260531-16:00:14 (UTC+8)260531-16:00:17 (UTC+8)
147P1 SFT step=1100/4376 epoch=0.503 loss=0.8514 260531-15:57:42 (UTC+8)260531-15:57:46 (UTC+8)
146P1 SFT step=1090/4376 epoch=0.498 loss=0.9372 260531-15:55:08 (UTC+8)260531-15:55:09 (UTC+8)
145P1 SFT step=1080/4376 epoch=0.494 loss=0.9458 260531-15:52:34 (UTC+8)260531-15:52:35 (UTC+8)
144P1 SFT step=1070/4376 epoch=0.489 loss=0.9689 260531-15:49:56 (UTC+8)260531-15:49:57 (UTC+8)
143P1 SFT step=1060/4376 epoch=0.485 loss=0.9441 260531-15:47:17 (UTC+8)260531-15:47:18 (UTC+8)
142P1 SFT step=1040/4376 epoch=0.475 loss=0.9160 260531-15:42:12 (UTC+8)260531-15:42:13 (UTC+8)
141P1 SFT step=1010/4376 epoch=0.462 loss=0.9623 260531-15:34:28 (UTC+8)260531-15:34:29 (UTC+8)
140P1 SFT step=970/4376 epoch=0.443 loss=1.0490 260531-15:23:55 (UTC+8)260531-15:23:57 (UTC+8)
139P1 SFT step=960/4376 epoch=0.439 loss=0.9971 260531-15:21:23 (UTC+8)260531-15:21:24 (UTC+8)
138P1 SFT step=950/4376 epoch=0.434 loss=0.9237 260531-15:18:48 (UTC+8)260531-15:18:50 (UTC+8)
137P1 SFT step=930/4376 epoch=0.425 loss=1.0076 260531-15:13:42 (UTC+8)260531-15:13:43 (UTC+8)
136P1 SFT step=910/4376 epoch=0.416 loss=1.0076 260531-15:08:29 (UTC+8)260531-15:08:30 (UTC+8)
135P1 SFT step=900/4376 epoch=0.411 loss=1.0087 260531-15:05:56 (UTC+8)260531-15:05:57 (UTC+8)
134P1 SFT step=890/4376 epoch=0.407 loss=0.9826 260531-15:03:22 (UTC+8)260531-15:03:24 (UTC+8)
133P1 SFT step=880/4376 epoch=0.402 loss=1.0578 260531-15:00:56 (UTC+8)260531-15:00:59 (UTC+8)
132P1 SFT step=870/4376 epoch=0.398 loss=1.0103 260531-14:58:27 (UTC+8)260531-14:58:28 (UTC+8)
131P1 SFT step=860/4376 epoch=0.393 loss=1.0776 260531-14:55:59 (UTC+8)260531-14:56:01 (UTC+8)
130P1 SFT step=840/4376 epoch=0.384 loss=0.9864 260531-14:50:45 (UTC+8)260531-14:50:46 (UTC+8)
129P1 SFT step=830/4376 epoch=0.379 loss=1.0428 260531-14:48:16 (UTC+8)260531-14:48:18 (UTC+8)
128P1 SFT step=820/4376 epoch=0.375 loss=1.0478 260531-14:45:47 (UTC+8)260531-14:45:48 (UTC+8)
127P1 SFT step=800/4376 epoch=0.366 loss=1.1587 260531-14:40:32 (UTC+8)260531-14:40:33 (UTC+8)
126P1 SFT step=790/4376 epoch=0.361 loss=1.1581 260531-14:37:54 (UTC+8)260531-14:37:55 (UTC+8)
125P1 SFT step=780/4376 epoch=0.357 loss=1.1194 260531-14:35:23 (UTC+8)260531-14:35:25 (UTC+8)
124P1 SFT step=770/4376 epoch=0.352 loss=1.1312 260531-14:32:48 (UTC+8)260531-14:32:49 (UTC+8)
123P1 SFT step=760/4376 epoch=0.347 loss=1.2450 260531-14:30:16 (UTC+8)260531-14:30:17 (UTC+8)
122P1 SFT step=750/4376 epoch=0.343 loss=1.0925 260531-14:27:45 (UTC+8)260531-14:27:46 (UTC+8)
121P1 SFT step=740/4376 epoch=0.338 loss=1.0655 260531-14:25:10 (UTC+8)260531-14:25:11 (UTC+8)
120P1 SFT step=730/4376 epoch=0.334 loss=1.1375 260531-14:22:37 (UTC+8)260531-14:22:38 (UTC+8)
119P1 SFT step=720/4376 epoch=0.329 loss=1.1547 260531-14:20:07 (UTC+8)260531-14:20:08 (UTC+8)
118P1 SFT step=710/4376 epoch=0.325 loss=1.1554 260531-14:17:35 (UTC+8)260531-14:17:36 (UTC+8)
117P1 SFT step=700/4376 epoch=0.320 loss=1.1277 260531-14:15:05 (UTC+8)260531-14:15:06 (UTC+8)
116P1 SFT step=690/4376 epoch=0.315 loss=1.1644 260531-14:12:25 (UTC+8)260531-14:12:27 (UTC+8)
115P1 SFT step=680/4376 epoch=0.311 loss=1.1867 260531-14:09:51 (UTC+8)260531-14:09:52 (UTC+8)
114P1 SFT step=670/4376 epoch=0.306 loss=1.1141 260531-14:07:19 (UTC+8)260531-14:07:21 (UTC+8)
113P1 SFT step=640/4376 epoch=0.293 loss=1.2210 260531-13:59:23 (UTC+8)260531-13:59:25 (UTC+8)
112P1 SFT step=630/4376 epoch=0.288 loss=1.1384 260531-13:56:54 (UTC+8)260531-13:56:55 (UTC+8)
111P1 SFT step=620/4376 epoch=0.283 loss=1.2562 260531-13:54:24 (UTC+8)260531-13:54:25 (UTC+8)
110P1 SFT step=600/4376 epoch=0.274 loss=1.2616 260531-13:49:19 (UTC+8)260531-13:49:20 (UTC+8)
109P1 SFT step=590/4376 epoch=0.270 loss=1.1777 260531-13:46:47 (UTC+8)260531-13:46:48 (UTC+8)
108P1 SFT step=580/4376 epoch=0.265 loss=1.2781 260531-13:44:16 (UTC+8)260531-13:44:17 (UTC+8)
107P1 SFT step=570/4376 epoch=0.261 loss=1.2426 260531-13:41:52 (UTC+8)260531-13:41:53 (UTC+8)
106P1 SFT step=560/4376 epoch=0.256 loss=1.1832 260531-13:39:18 (UTC+8)260531-13:39:19 (UTC+8)
105P1 SFT step=550/4376 epoch=0.251 loss=1.2610 260531-13:36:36 (UTC+8)260531-13:36:38 (UTC+8)
104P1 SFT step=540/4376 epoch=0.247 loss=1.2770 260531-13:34:05 (UTC+8)260531-13:34:06 (UTC+8)
103P1 SFT step=530/4376 epoch=0.242 loss=1.2558 260531-13:31:29 (UTC+8)260531-13:31:30 (UTC+8)
102P1 SFT step=510/4376 epoch=0.233 loss=1.3382 260531-13:26:18 (UTC+8)260531-13:26:19 (UTC+8)
101P1 SFT step=500/4376 epoch=0.229 loss=1.2948 260531-13:23:40 (UTC+8)260531-13:23:41 (UTC+8)
100P1 SFT step=490/4376 epoch=0.224 loss=1.2699 260531-13:21:05 (UTC+8)260531-13:21:07 (UTC+8)
99P1 SFT step=480/4376 epoch=0.219 loss=1.3112 260531-13:18:33 (UTC+8)260531-13:18:34 (UTC+8)
98P1 SFT step=470/4376 epoch=0.215 loss=1.4470 260531-13:15:56 (UTC+8)260531-13:15:58 (UTC+8)
97P1 SFT step=450/4376 epoch=0.206 loss=1.4009 260531-13:10:41 (UTC+8)260531-13:10:42 (UTC+8)
96P1 SFT step=440/4376 epoch=0.201 loss=1.3398 260531-13:08:03 (UTC+8)260531-13:08:04 (UTC+8)
95P1 SFT step=430/4376 epoch=0.197 loss=1.3960 260531-13:04:04 (UTC+8)260531-13:05:30 (UTC+8)
94P1 SFT step=420/4376 epoch=0.192 loss=1.3507 260531-13:01:35 (UTC+8)260531-13:02:55 (UTC+8)
93P1 SFT step=360/4376 epoch=0.165 loss=1.5046 260531-12:46:33 (UTC+8)260531-12:47:15 (UTC+8)
92P1 SFT step=340/4376 epoch=0.155 loss=1.4792 260531-12:41:32 (UTC+8)260531-12:42:01 (UTC+8)
91P1 SFT step=330/4376 epoch=0.151 loss=1.5215 260531-12:39:05 (UTC+8)260531-12:39:29 (UTC+8)
90P1 SFT step=320/4376 epoch=0.146 loss=1.6060 260531-12:36:32 (UTC+8)260531-12:36:50 (UTC+8)
89P1 SFT step=310/4376 epoch=0.142 loss=1.7043 260531-12:34:08 (UTC+8)260531-12:34:19 (UTC+8)
88P1 SFT step=300/4376 epoch=0.137 loss=1.5087 260531-12:31:41 (UTC+8)260531-12:31:46 (UTC+8)
87P1 SFT step=290/4376 epoch=0.133 loss=1.4959 260531-12:29:11 (UTC+8)260531-12:29:14 (UTC+8)
86P1 SFT step=280/4376 epoch=0.128 loss=1.7216 260531-12:26:43 (UTC+8)260531-12:26:44 (UTC+8)
85P1 SFT step=260/4376 epoch=0.119 loss=1.6852 260531-12:21:37 (UTC+8)260531-12:21:38 (UTC+8)
84P1 SFT step=250/4376 epoch=0.114 loss=1.7114 260531-12:19:06 (UTC+8)260531-12:19:07 (UTC+8)
83P1 SFT step=240/4376 epoch=0.110 loss=1.6723 260531-12:16:34 (UTC+8)260531-12:16:35 (UTC+8)
82P1 SFT step=230/4376 epoch=0.105 loss=1.8268 260531-12:13:58 (UTC+8)260531-12:14:00 (UTC+8)
81P1 SFT step=210/4376 epoch=0.096 loss=1.8581 260531-12:08:43 (UTC+8)260531-12:08:45 (UTC+8)
80P1 SFT step=200/4376 epoch=0.091 loss=1.9446 260531-12:06:08 (UTC+8)260531-12:06:09 (UTC+8)
79P1 SFT step=190/4376 epoch=0.087 loss=1.9206 260531-12:03:31 (UTC+8)260531-12:03:31 (UTC+8)
78P1 SFT step=170/4376 epoch=0.078 loss=1.9933 260531-11:58:07 (UTC+8)260531-11:58:08 (UTC+8)
77P1 SFT step=160/4376 epoch=0.073 loss=2.0111 260531-11:55:33 (UTC+8)260531-11:55:35 (UTC+8)
76P1 SFT step=150/4376 epoch=0.069 loss=2.0783 260531-11:53:07 (UTC+8)260531-11:53:09 (UTC+8)
75P1 SFT step=140/4376 epoch=0.064 loss=2.1542 260531-11:50:34 (UTC+8)260531-11:50:36 (UTC+8)
74P1 SFT step=130/4376 epoch=0.059 loss=2.2176 260531-11:48:07 (UTC+8)260531-11:48:08 (UTC+8)
73P1 SFT step=120/4376 epoch=0.055 loss=2.3084 260531-11:45:38 (UTC+8)260531-11:45:39 (UTC+8)
72P1 SFT step=110/4376 epoch=0.050 loss=2.3456 260531-11:43:04 (UTC+8)260531-11:43:06 (UTC+8)
71P1 SFT step=100/4376 epoch=0.046 loss=2.4323 260531-11:40:34 (UTC+8)260531-11:40:37 (UTC+8)
70P1 SFT step=90/4376 epoch=0.041 loss=2.5779 260531-11:37:59 (UTC+8)260531-11:38:01 (UTC+8)
69P1 SFT step=80/4376 epoch=0.037 loss=2.5794 260531-11:35:24 (UTC+8)260531-11:35:25 (UTC+8)
68P1 SFT step=70/4376 epoch=0.032 loss=2.6889 260531-11:32:49 (UTC+8)260531-11:32:51 (UTC+8)
67P1 SFT step=60/4376 epoch=0.027 loss=2.7774 260531-11:30:16 (UTC+8)260531-11:30:17 (UTC+8)
66P1 SFT step=50/4376 epoch=0.023 loss=2.9239 260531-11:27:47 (UTC+8)260531-11:27:48 (UTC+8)
65P1 SFT step=40/4376 epoch=0.018 loss=3.0560 260531-11:25:16 (UTC+8)260531-11:25:17 (UTC+8)
64P1 SFT step=30/4376 epoch=0.014 loss=3.3015 260531-11:22:43 (UTC+8)260531-11:22:45 (UTC+8)
63P1 SFT step=20/4376 epoch=0.009 loss=3.5415 260531-11:20:09 (UTC+8)260531-11:20:10 (UTC+8)
62P1 SFT step=10/4376 epoch=0.005 loss=3.7261 260531-11:17:35 (UTC+8)260531-11:17:39 (UTC+8)
61启动核心实验:P1 260531-11:12:25 (UTC+8)260531-11:12:26 (UTC+8)
60完成核心实验:P0 260531-11:12:24 (UTC+8)260531-11:12:25 (UTC+8)
59P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260531-11:12:23 (UTC+8)260531-11:12:24 (UTC+8)
58P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260531-11:12:22 (UTC+8)260531-11:12:22 (UTC+8)
57启动核心实验:P0 260531-11:12:18 (UTC+8)260531-11:12:19 (UTC+8)
56run.py 正常启动:device=cuda:0 n_trials=40 start_at=P0 sft_prompts=35000 bank_prompts=35000 | 顺序=P0 tokenized raw embedding -> P1 LLM SFT -> P2 SFT/P4格式审计 -> P4 SFT hidden bank -> P3 sanity -> P5 Optuna 260531-11:12:17 (UTC+8)260531-11:12:18 (UTC+8)
55P1 SFT step=120/4376 epoch=0.055 loss=2.2464 260531-11:03:22 (UTC+8)260531-11:03:23 (UTC+8)
54P1 SFT step=110/4376 epoch=0.050 loss=2.4006 260531-11:00:52 (UTC+8)260531-11:00:53 (UTC+8)
53P1 SFT step=100/4376 epoch=0.046 loss=2.4651 260531-10:58:21 (UTC+8)260531-10:58:23 (UTC+8)
52P1 SFT step=90/4376 epoch=0.041 loss=2.5019 260531-10:55:47 (UTC+8)260531-10:55:48 (UTC+8)
51P1 SFT step=80/4376 epoch=0.037 loss=2.5970 260531-10:53:21 (UTC+8)260531-10:53:23 (UTC+8)
50P1 SFT step=70/4376 epoch=0.032 loss=2.7185 260531-10:50:54 (UTC+8)260531-10:50:56 (UTC+8)
49P1 SFT step=60/4376 epoch=0.027 loss=2.8398 260531-10:48:25 (UTC+8)260531-10:48:26 (UTC+8)
48P1 SFT step=50/4376 epoch=0.023 loss=3.0052 260531-10:45:58 (UTC+8)260531-10:45:58 (UTC+8)
47P1 SFT step=40/4376 epoch=0.018 loss=3.0347 260531-10:43:24 (UTC+8)260531-10:43:26 (UTC+8)
46P1 SFT step=20/4376 epoch=0.009 loss=3.5791 260531-10:38:20 (UTC+8)260531-10:38:22 (UTC+8)
45P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260531-10:30:51 (UTC+8)260531-10:30:53 (UTC+8)
44启动核心实验:P1 260531-10:30:41 (UTC+8)260531-10:30:42 (UTC+8)
43完成核心实验:P0 260531-10:30:40 (UTC+8)260531-10:30:41 (UTC+8)
42P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260531-10:30:38 (UTC+8)260531-10:30:39 (UTC+8)
41P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260531-10:30:37 (UTC+8)260531-10:30:38 (UTC+8)
40启动核心实验:P0 260531-10:30:33 (UTC+8)260531-10:30:34 (UTC+8)
39run.py 正常启动:device=cuda:0 n_trials=40 start_at=P0 sft_prompts=35000 bank_prompts=35000 | 顺序=P0 tokenized raw embedding -> P1 LLM SFT -> P2 SFT/P4格式审计 -> P4 SFT hidden bank -> P3 sanity -> P5 Optuna 260531-10:30:32 (UTC+8)260531-10:30:33 (UTC+8)
38P1 SFT step=10/74 epoch=0.276 loss=3.4033 260531-10:21:06 (UTC+8)260531-10:21:07 (UTC+8)
37P1 启动:Wiki-CS LLM SFT | Alpaca completion | device=cuda:0 260531-10:17:57 (UTC+8)260531-10:17:58 (UTC+8)
36启动核心实验:P1 260531-10:17:54 (UTC+8)260531-10:17:54 (UTC+8)
35完成核心实验:P0 260531-10:17:53 (UTC+8)260531-10:17:53 (UTC+8)
34P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260531-10:17:50 (UTC+8)260531-10:17:52 (UTC+8)
33P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260531-10:17:48 (UTC+8)260531-10:17:50 (UTC+8)
32启动核心实验:P0 260531-10:17:44 (UTC+8)260531-10:17:46 (UTC+8)
31run.py 正常启动:device=cuda:0 n_trials=40 start_at=P0 | 顺序=P0 tokenized raw embedding -> P1 LLM SFT -> P2 SFT/P4格式审计 -> P4 SFT hidden bank -> P3 sanity -> P5 Optuna 260531-10:17:43 (UTC+8)260531-10:17:45 (UTC+8)
30P5 trial 5 启动:seed=3052 260531-09:39:40 (UTC+8)260531-09:39:42 (UTC+8)
29P5 trial 4 完成:val=77.5014 test=75.7140 260531-09:39:39 (UTC+8)260531-09:39:41 (UTC+8)
28P5 trial 4 启动:seed=3051 260531-09:39:25 (UTC+8)260531-09:39:26 (UTC+8)
27P5 trial 3 完成:val=79.7626 test=78.0742 260531-09:39:24 (UTC+8)260531-09:39:25 (UTC+8)
26补充确认:Wiki-CS run.py 已正常启动,P0-P4 完成,P5 Optuna 已进入 trial 阶段,学生输入为 tokenized LLM raw embedding [11701,4096] 260531-09:38:59 (UTC+8)260531-09:39:00 (UTC+8)
25P5 trial 3 启动:seed=3050 260531-09:38:36 (UTC+8)260531-09:38:37 (UTC+8)
24P5 trial 2 完成:val=78.1232 test=75.8509 260531-09:38:35 (UTC+8)260531-09:38:36 (UTC+8)
23P5 trial 2 启动:seed=3049 260531-09:38:04 (UTC+8)260531-09:38:05 (UTC+8)
22P5 trial 1 完成:val=79.3669 test=77.3217 260531-09:38:03 (UTC+8)260531-09:38:04 (UTC+8)
21P5 trial 1 启动:seed=3048 260531-09:37:52 (UTC+8)260531-09:37:53 (UTC+8)
20P5 启动:Optuna trial 搜索 n_trials=40 device=cuda:0 260531-09:37:50 (UTC+8)260531-09:37:51 (UTC+8)
19启动核心实验:P5 260531-09:37:47 (UTC+8)260531-09:37:47 (UTC+8)
18完成核心实验:P4 260531-09:37:46 (UTC+8)260531-09:37:46 (UTC+8)
17P4 完成:bank index=wikics_bank_index.csv labels=10 260531-09:37:43 (UTC+8)260531-09:37:45 (UTC+8)
16P4 启动:导出 bank 标签映射和轻量索引 260531-09:37:42 (UTC+8)260531-09:37:44 (UTC+8)
15启动核心实验:P4 260531-09:37:38 (UTC+8)260531-09:37:40 (UTC+8)
14完成核心实验:P3 260531-09:37:37 (UTC+8)260531-09:37:39 (UTC+8)
13启动核心实验:P3 260531-09:37:23 (UTC+8)260531-09:37:24 (UTC+8)
12完成核心实验:P2 260531-09:37:22 (UTC+8)260531-09:37:23 (UTC+8)
11P2 完成:bank=wikics_sem_topo_bank.pt 260531-09:37:20 (UTC+8)260531-09:37:21 (UTC+8)
10P2 启动:从 Phase1 cache 构建 sem/topo bank 260531-09:37:19 (UTC+8)260531-09:37:20 (UTC+8)
9启动核心实验:P2 260531-09:37:15 (UTC+8)260531-09:37:16 (UTC+8)
8完成核心实验:P1 260531-09:37:14 (UTC+8)260531-09:37:15 (UTC+8)
7P1 完成:Phase1 cache=phase1_cache_wikics_bestVal.pt sem/topo=(11701, 128) 260531-09:37:13 (UTC+8)260531-09:37:13 (UTC+8)
6P1 启动:生成 Phase1 teacher cache d_z=128 260531-09:37:10 (UTC+8)260531-09:37:11 (UTC+8)
5启动核心实验:P1 260531-09:37:05 (UTC+8)260531-09:37:07 (UTC+8)
4P0 完成:tokenized LLM embedding=[11701, 4096] nodes=11701 260531-09:36:59 (UTC+8)260531-09:37:00 (UTC+8)
3P0 启动:从 wikics.pt:raw_texts 生成 tokenized LLM 原始 embedding 260531-09:36:57 (UTC+8)260531-09:36:59 (UTC+8)
2启动核心实验:P0 260531-09:36:54 (UTC+8)260531-09:36:55 (UTC+8)
1run.py 正常启动:device=cuda:0 n_trials=40 start_at=P0 260531-09:36:53 (UTC+8)260531-09:36:54 (UTC+8)