06/12/20 00:04:24 (pid:15563) DOCKER is undefined. 06/12/20 00:04:24 (pid:15563) DockerAPI::detect() failed to detect the Docker version; assuming absent. 06/12/20 00:04:37 (pid:20894) ****************************************************** 06/12/20 00:04:37 (pid:20894) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 00:04:37 (pid:20894) ** /usr/sbin/condor_starter 06/12/20 00:04:37 (pid:20894) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 00:04:37 (pid:20894) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 00:04:37 (pid:20894) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 00:04:37 (pid:20894) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 00:04:37 (pid:20894) ** PID = 20894 06/12/20 00:04:37 (pid:20894) ** Log last touched 6/12 00:04:27 06/12/20 00:04:37 (pid:20894) ****************************************************** 06/12/20 00:04:37 (pid:20894) Using config source: /etc/condor/condor_config 06/12/20 00:04:37 (pid:20894) Using local config sources: 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/10_security.config 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/14_network.config 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/20_workernode.config 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/30_lease.config 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/35_cms.config 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/40_ccb.config 06/12/20 00:04:37 (pid:20894) /etc/condor/config.d/62-benchmark.conf 06/12/20 00:04:37 (pid:20894) /etc/condor/condor_config.local 06/12/20 00:04:37 (pid:20894) config Macros = 172, Sorted = 172, StringBytes = 6936, TablesBytes = 6296 06/12/20 00:04:37 (pid:20894) CLASSAD_CACHING is OFF 06/12/20 00:04:37 (pid:20894) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 00:04:37 (pid:20894) Daemoncore: Listening at <10.0.2.15:36859> on TCP (ReliSock). 06/12/20 00:04:37 (pid:20894) DaemonCore: command socket at <10.0.2.15:36859?addrs=10.0.2.15-36859&noUDP> 06/12/20 00:04:37 (pid:20894) DaemonCore: private command socket at <10.0.2.15:36859?addrs=10.0.2.15-36859> 06/12/20 00:04:48 (pid:20894) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143569 06/12/20 00:04:48 (pid:20894) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15495> 06/12/20 00:04:48 (pid:20894) Submitting machine is "vocms0267.cern.ch" 06/12/20 00:04:48 (pid:20894) setting the orig job name in starter 06/12/20 00:04:48 (pid:20894) setting the orig job iwd in starter 06/12/20 00:04:48 (pid:20894) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 00:04:48 (pid:20894) Initialized IO Proxy. 06/12/20 00:04:48 (pid:20894) Done setting resource limits 06/12/20 00:04:52 (pid:20894) File transfer completed successfully. 06/12/20 00:04:52 (pid:20894) Job 298139.2 set to execute immediately 06/12/20 00:04:52 (pid:20894) Starting a VANILLA universe job with ID: 298139.2 06/12/20 00:04:52 (pid:20894) IWD: /var/lib/condor/execute/dir_20894 06/12/20 00:04:52 (pid:20894) Output file: /var/lib/condor/execute/dir_20894/_condor_stdout 06/12/20 00:04:52 (pid:20894) Error file: /var/lib/condor/execute/dir_20894/_condor_stderr 06/12/20 00:04:52 (pid:20894) Renice expr "10" evaluated to 10 06/12/20 00:04:52 (pid:20894) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_20894/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200609_004711_8276-Sandbox.tar.bz2 18911 0 06/12/20 00:04:52 (pid:20894) Running job as user nobody 06/12/20 00:04:52 (pid:20894) Create_Process succeeded, pid=28703 06/12/20 00:50:26 (pid:20894) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 00:50:26 (pid:20894) IO: Failed to read packet header 06/12/20 00:50:26 (pid:20894) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 01:10:26 (pid:20894) No reconnect from shadow for 1200 seconds, aborting job execution! 06/12/20 01:10:26 (pid:20894) ShutdownFast all jobs. 06/12/20 01:10:26 (pid:20894) Process exited, pid=28703, signal=9 06/12/20 01:10:26 (pid:20894) Failed to send job exit status to shadow 06/12/20 01:10:26 (pid:20894) Last process exited, now Starter is exiting 06/12/20 01:10:26 (pid:20894) **** condor_starter (condor_STARTER) pid 20894 EXITING WITH STATUS 2 06/12/20 01:10:42 (pid:1519) ****************************************************** 06/12/20 01:10:42 (pid:1519) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 01:10:42 (pid:1519) ** /usr/sbin/condor_starter 06/12/20 01:10:42 (pid:1519) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 01:10:42 (pid:1519) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 01:10:42 (pid:1519) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 01:10:42 (pid:1519) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 01:10:42 (pid:1519) ** PID = 1519 06/12/20 01:10:42 (pid:1519) ** Log last touched 6/12 01:10:26 06/12/20 01:10:42 (pid:1519) ****************************************************** 06/12/20 01:10:42 (pid:1519) Using config source: /etc/condor/condor_config 06/12/20 01:10:42 (pid:1519) Using local config sources: 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/10_security.config 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/14_network.config 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/20_workernode.config 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/30_lease.config 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/35_cms.config 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/40_ccb.config 06/12/20 01:10:42 (pid:1519) /etc/condor/config.d/62-benchmark.conf 06/12/20 01:10:42 (pid:1519) /etc/condor/condor_config.local 06/12/20 01:10:42 (pid:1519) config Macros = 172, Sorted = 172, StringBytes = 6934, TablesBytes = 6296 06/12/20 01:10:42 (pid:1519) CLASSAD_CACHING is OFF 06/12/20 01:10:42 (pid:1519) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 01:10:42 (pid:1519) Daemoncore: Listening at <10.0.2.15:37279> on TCP (ReliSock). 06/12/20 01:10:42 (pid:1519) DaemonCore: command socket at <10.0.2.15:37279?addrs=10.0.2.15-37279&noUDP> 06/12/20 01:10:42 (pid:1519) DaemonCore: private command socket at <10.0.2.15:37279?addrs=10.0.2.15-37279> 06/12/20 01:10:52 (pid:1519) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143679 06/12/20 01:10:53 (pid:1519) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 01:10:53 (pid:1519) Submitting machine is "vocms0267.cern.ch" 06/12/20 01:10:53 (pid:1519) setting the orig job name in starter 06/12/20 01:10:53 (pid:1519) setting the orig job iwd in starter 06/12/20 01:10:53 (pid:1519) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 01:10:53 (pid:1519) Initialized IO Proxy. 06/12/20 01:10:53 (pid:1519) Done setting resource limits 06/12/20 01:10:56 (pid:1519) File transfer completed successfully. 06/12/20 01:10:56 (pid:1519) Job 298166.1 set to execute immediately 06/12/20 01:10:56 (pid:1519) Starting a VANILLA universe job with ID: 298166.1 06/12/20 01:10:56 (pid:1519) IWD: /var/lib/condor/execute/dir_1519 06/12/20 01:10:56 (pid:1519) Output file: /var/lib/condor/execute/dir_1519/_condor_stdout 06/12/20 01:10:56 (pid:1519) Error file: /var/lib/condor/execute/dir_1519/_condor_stderr 06/12/20 01:10:56 (pid:1519) Renice expr "10" evaluated to 10 06/12/20 01:10:56 (pid:1519) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_1519/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200609_004711_8276-Sandbox.tar.bz2 16704 1 06/12/20 01:10:56 (pid:1519) Running job as user nobody 06/12/20 01:10:56 (pid:1519) Create_Process succeeded, pid=1544 06/12/20 02:16:29 (pid:1519) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 02:16:29 (pid:1519) IO: Failed to read packet header 06/12/20 02:16:29 (pid:1519) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 02:17:36 (pid:1519) Accepted request to reconnect from <:0> 06/12/20 02:17:36 (pid:1519) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 02:17:36 (pid:1519) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 02:17:36 (pid:1519) Recovered connection to shadow after 67 seconds 06/12/20 02:33:26 (pid:1519) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> on <137.138.52.94:15851> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3650091_0fe7_3>. 06/12/20 02:33:26 (pid:1519) IO: Failed to read packet header 06/12/20 02:33:26 (pid:1519) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 02:33:45 (pid:1519) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 02:33:45 (pid:1519) IO: Failed to read packet header 06/12/20 02:33:45 (pid:1519) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 02:33:45 (pid:1519) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 02:34:46 (pid:1519) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143679 06/12/20 02:40:06 (pid:1519) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 02:40:06 (pid:1519) IO: Failed to read packet header 06/12/20 02:40:06 (pid:1519) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 02:40:06 (pid:1519) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 02:41:34 (pid:1519) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143679 06/12/20 02:42:10 (pid:1519) Accepted request to reconnect from <:0> 06/12/20 02:42:10 (pid:1519) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 02:42:10 (pid:1519) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 02:42:10 (pid:1519) Recovered connection to shadow after 524 seconds 06/12/20 02:48:12 (pid:1519) Process exited, pid=1544, status=0 06/12/20 02:48:13 (pid:1519) Got SIGQUIT. Performing fast shutdown. 06/12/20 02:48:13 (pid:1519) ShutdownFast all jobs. 06/12/20 02:48:13 (pid:1519) **** condor_starter (condor_STARTER) pid 1519 EXITING WITH STATUS 0 06/12/20 02:48:13 (pid:8630) ****************************************************** 06/12/20 02:48:13 (pid:8630) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 02:48:13 (pid:8630) ** /usr/sbin/condor_starter 06/12/20 02:48:13 (pid:8630) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 02:48:13 (pid:8630) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 02:48:13 (pid:8630) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 02:48:13 (pid:8630) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 02:48:13 (pid:8630) ** PID = 8630 06/12/20 02:48:13 (pid:8630) ** Log last touched 6/12 02:48:13 06/12/20 02:48:13 (pid:8630) ****************************************************** 06/12/20 02:48:13 (pid:8630) Using config source: /etc/condor/condor_config 06/12/20 02:48:13 (pid:8630) Using local config sources: 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/10_security.config 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/14_network.config 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/20_workernode.config 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/30_lease.config 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/35_cms.config 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/40_ccb.config 06/12/20 02:48:13 (pid:8630) /etc/condor/config.d/62-benchmark.conf 06/12/20 02:48:13 (pid:8630) /etc/condor/condor_config.local 06/12/20 02:48:13 (pid:8630) config Macros = 172, Sorted = 172, StringBytes = 6934, TablesBytes = 6296 06/12/20 02:48:13 (pid:8630) CLASSAD_CACHING is OFF 06/12/20 02:48:13 (pid:8630) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 02:48:13 (pid:8630) Daemoncore: Listening at <10.0.2.15:34299> on TCP (ReliSock). 06/12/20 02:48:13 (pid:8630) DaemonCore: command socket at <10.0.2.15:34299?addrs=10.0.2.15-34299&noUDP> 06/12/20 02:48:13 (pid:8630) DaemonCore: private command socket at <10.0.2.15:34299?addrs=10.0.2.15-34299> 06/12/20 02:48:24 (pid:8630) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143858 06/12/20 02:48:24 (pid:8630) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 02:48:24 (pid:8630) Submitting machine is "vocms0267.cern.ch" 06/12/20 02:48:24 (pid:8630) setting the orig job name in starter 06/12/20 02:48:24 (pid:8630) setting the orig job iwd in starter 06/12/20 02:48:24 (pid:8630) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 02:48:24 (pid:8630) Initialized IO Proxy. 06/12/20 02:48:24 (pid:8630) Done setting resource limits 06/12/20 02:48:27 (pid:8630) File transfer completed successfully. 06/12/20 02:48:27 (pid:8630) Job 298207.0 set to execute immediately 06/12/20 02:48:27 (pid:8630) Starting a VANILLA universe job with ID: 298207.0 06/12/20 02:48:27 (pid:8630) IWD: /var/lib/condor/execute/dir_8630 06/12/20 02:48:27 (pid:8630) Output file: /var/lib/condor/execute/dir_8630/_condor_stdout 06/12/20 02:48:27 (pid:8630) Error file: /var/lib/condor/execute/dir_8630/_condor_stderr 06/12/20 02:48:27 (pid:8630) Renice expr "10" evaluated to 10 06/12/20 02:48:27 (pid:8630) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_8630/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200609_004711_8276-Sandbox.tar.bz2 19051 0 06/12/20 02:48:27 (pid:8630) Running job as user nobody 06/12/20 02:48:27 (pid:8630) Create_Process succeeded, pid=8644 06/12/20 03:18:43 (pid:8630) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 03:18:43 (pid:8630) IO: Failed to read packet header 06/12/20 03:18:43 (pid:8630) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 03:18:43 (pid:8630) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 03:19:44 (pid:8630) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143858 06/12/20 03:34:01 (pid:8630) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 03:34:01 (pid:8630) IO: Failed to read packet header 06/12/20 03:34:01 (pid:8630) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 03:35:08 (pid:8630) Accepted request to reconnect from <:0> 06/12/20 03:35:08 (pid:8630) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 03:35:08 (pid:8630) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 03:35:08 (pid:8630) Recovered connection to shadow after 67 seconds 06/12/20 03:55:27 (pid:8630) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 03:55:27 (pid:8630) IO: Failed to read packet header 06/12/20 03:55:27 (pid:8630) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 03:55:27 (pid:8630) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 03:56:48 (pid:8630) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143858 06/12/20 04:09:04 (pid:8630) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> on <137.138.52.94:6842> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3650091_0fe7_15>. 06/12/20 04:09:04 (pid:8630) IO: Failed to read packet header 06/12/20 04:09:04 (pid:8630) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 04:09:21 (pid:8630) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 04:09:21 (pid:8630) IO: Failed to read packet header 06/12/20 04:09:21 (pid:8630) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 04:09:21 (pid:8630) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 04:10:22 (pid:8630) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2143858 06/12/20 04:14:18 (pid:8630) Accepted request to reconnect from <:0> 06/12/20 04:14:18 (pid:8630) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 04:14:18 (pid:8630) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 04:14:18 (pid:8630) Recovered connection to shadow after 314 seconds 06/12/20 04:49:44 (pid:8630) Process exited, pid=8644, status=37 06/12/20 04:49:46 (pid:8630) Got SIGQUIT. Performing fast shutdown. 06/12/20 04:49:46 (pid:8630) ShutdownFast all jobs. 06/12/20 04:49:46 (pid:8630) **** condor_starter (condor_STARTER) pid 8630 EXITING WITH STATUS 0 06/12/20 04:49:46 (pid:17364) ****************************************************** 06/12/20 04:49:46 (pid:17364) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 04:49:46 (pid:17364) ** /usr/sbin/condor_starter 06/12/20 04:49:46 (pid:17364) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 04:49:46 (pid:17364) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 04:49:46 (pid:17364) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 04:49:46 (pid:17364) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 04:49:46 (pid:17364) ** PID = 17364 06/12/20 04:49:46 (pid:17364) ** Log last touched 6/12 04:49:46 06/12/20 04:49:46 (pid:17364) ****************************************************** 06/12/20 04:49:46 (pid:17364) Using config source: /etc/condor/condor_config 06/12/20 04:49:46 (pid:17364) Using local config sources: 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/10_security.config 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/14_network.config 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/20_workernode.config 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/30_lease.config 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/35_cms.config 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/40_ccb.config 06/12/20 04:49:46 (pid:17364) /etc/condor/config.d/62-benchmark.conf 06/12/20 04:49:46 (pid:17364) /etc/condor/condor_config.local 06/12/20 04:49:46 (pid:17364) config Macros = 172, Sorted = 172, StringBytes = 6936, TablesBytes = 6296 06/12/20 04:49:46 (pid:17364) CLASSAD_CACHING is OFF 06/12/20 04:49:46 (pid:17364) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 04:49:46 (pid:17364) Daemoncore: Listening at <10.0.2.15:35061> on TCP (ReliSock). 06/12/20 04:49:46 (pid:17364) DaemonCore: command socket at <10.0.2.15:35061?addrs=10.0.2.15-35061&noUDP> 06/12/20 04:49:46 (pid:17364) DaemonCore: private command socket at <10.0.2.15:35061?addrs=10.0.2.15-35061> 06/12/20 04:49:57 (pid:17364) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144111 06/12/20 04:49:57 (pid:17364) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15537> 06/12/20 04:49:57 (pid:17364) Submitting machine is "vocms0267.cern.ch" 06/12/20 04:49:57 (pid:17364) setting the orig job name in starter 06/12/20 04:49:57 (pid:17364) setting the orig job iwd in starter 06/12/20 04:49:57 (pid:17364) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 04:49:57 (pid:17364) Initialized IO Proxy. 06/12/20 04:49:57 (pid:17364) Done setting resource limits 06/12/20 04:50:00 (pid:17364) File transfer completed successfully. 06/12/20 04:50:00 (pid:17364) Job 298283.0 set to execute immediately 06/12/20 04:50:00 (pid:17364) Starting a VANILLA universe job with ID: 298283.0 06/12/20 04:50:00 (pid:17364) IWD: /var/lib/condor/execute/dir_17364 06/12/20 04:50:00 (pid:17364) Output file: /var/lib/condor/execute/dir_17364/_condor_stdout 06/12/20 04:50:00 (pid:17364) Error file: /var/lib/condor/execute/dir_17364/_condor_stderr 06/12/20 04:50:00 (pid:17364) Renice expr "10" evaluated to 10 06/12/20 04:50:00 (pid:17364) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_17364/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200609_004711_8276-Sandbox.tar.bz2 19203 0 06/12/20 04:50:00 (pid:17364) Running job as user nobody 06/12/20 04:50:00 (pid:17364) Create_Process succeeded, pid=17391 06/12/20 06:00:16 (pid:17364) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 06:00:16 (pid:17364) IO: Failed to read packet header 06/12/20 06:00:16 (pid:17364) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 06:00:16 (pid:17364) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 06:01:17 (pid:17364) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144111 06/12/20 06:26:59 (pid:17364) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 06:26:59 (pid:17364) IO: Failed to read packet header 06/12/20 06:26:59 (pid:17364) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 06:26:59 (pid:17364) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 06:28:40 (pid:17364) SECMAN: enable_mac has no key to use, failing... 06/12/20 06:28:40 (pid:17364) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 06:28:40 (pid:17364) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 06:29:41 (pid:17364) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144310 06/12/20 06:35:00 (pid:17364) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 06:35:00 (pid:17364) IO: Failed to read packet header 06/12/20 06:35:00 (pid:17364) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 06:35:00 (pid:17364) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 06:39:48 (pid:17364) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 06:39:48 (pid:17364) IO: Failed to read packet header 06/12/20 06:39:48 (pid:17364) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 06:39:48 (pid:17364) Process exited, pid=17391, status=0 06/12/20 06:39:48 (pid:17364) Returning from CStarter::JobReaper() 06/12/20 06:39:50 (pid:17364) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144335 06/12/20 06:45:09 (pid:17364) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 06:45:09 (pid:17364) IO: Failed to read packet header 06/12/20 06:45:09 (pid:17364) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 06:45:09 (pid:17364) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 06:46:10 (pid:17364) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144335 06/12/20 06:56:44 (pid:17364) Got SIGTERM. Performing graceful shutdown. 06/12/20 06:56:44 (pid:17364) ShutdownGraceful all jobs. 06/12/20 06:56:44 (pid:17364) Failed to send job exit status to shadow 06/12/20 06:56:44 (pid:17364) JobExit() failed, waiting for job lease to expire or for a reconnect attempt 06/12/20 06:58:44 (pid:17364) ShutdownFast all jobs. 06/12/20 06:58:44 (pid:17364) Failed to send job exit status to shadow 06/12/20 06:58:44 (pid:17364) **** condor_starter (condor_STARTER) pid 17364 EXITING WITH STATUS 0 06/12/20 06:59:03 (pid:26367) ****************************************************** 06/12/20 06:59:03 (pid:26367) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 06:59:03 (pid:26367) ** /usr/sbin/condor_starter 06/12/20 06:59:03 (pid:26367) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 06:59:03 (pid:26367) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 06:59:03 (pid:26367) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 06:59:03 (pid:26367) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 06:59:03 (pid:26367) ** PID = 26367 06/12/20 06:59:03 (pid:26367) ** Log last touched 6/12 06:58:44 06/12/20 06:59:03 (pid:26367) ****************************************************** 06/12/20 06:59:03 (pid:26367) Using config source: /etc/condor/condor_config 06/12/20 06:59:03 (pid:26367) Using local config sources: 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/10_security.config 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/14_network.config 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/20_workernode.config 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/30_lease.config 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/35_cms.config 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/40_ccb.config 06/12/20 06:59:03 (pid:26367) /etc/condor/config.d/62-benchmark.conf 06/12/20 06:59:03 (pid:26367) /etc/condor/condor_config.local 06/12/20 06:59:03 (pid:26367) config Macros = 172, Sorted = 172, StringBytes = 6936, TablesBytes = 6296 06/12/20 06:59:03 (pid:26367) CLASSAD_CACHING is OFF 06/12/20 06:59:03 (pid:26367) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 06:59:03 (pid:26367) Daemoncore: Listening at <10.0.2.15:39763> on TCP (ReliSock). 06/12/20 06:59:03 (pid:26367) DaemonCore: command socket at <10.0.2.15:39763?addrs=10.0.2.15-39763&noUDP> 06/12/20 06:59:03 (pid:26367) DaemonCore: private command socket at <10.0.2.15:39763?addrs=10.0.2.15-39763> 06/12/20 06:59:14 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 06:59:15 (pid:26367) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 06:59:15 (pid:26367) Submitting machine is "vocms0267.cern.ch" 06/12/20 06:59:15 (pid:26367) setting the orig job name in starter 06/12/20 06:59:15 (pid:26367) setting the orig job iwd in starter 06/12/20 06:59:15 (pid:26367) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 06:59:15 (pid:26367) Initialized IO Proxy. 06/12/20 06:59:15 (pid:26367) Done setting resource limits 06/12/20 06:59:18 (pid:26367) File transfer completed successfully. 06/12/20 06:59:18 (pid:26367) Job 298361.5 set to execute immediately 06/12/20 06:59:18 (pid:26367) Starting a VANILLA universe job with ID: 298361.5 06/12/20 06:59:18 (pid:26367) IWD: /var/lib/condor/execute/dir_26367 06/12/20 06:59:18 (pid:26367) Output file: /var/lib/condor/execute/dir_26367/_condor_stdout 06/12/20 06:59:18 (pid:26367) Error file: /var/lib/condor/execute/dir_26367/_condor_stderr 06/12/20 06:59:18 (pid:26367) Renice expr "10" evaluated to 10 06/12/20 06:59:18 (pid:26367) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_26367/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200609_004711_8276-Sandbox.tar.bz2 19354 0 06/12/20 06:59:18 (pid:26367) Running job as user nobody 06/12/20 06:59:18 (pid:26367) Create_Process succeeded, pid=26391 06/12/20 07:04:33 (pid:26367) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 07:04:33 (pid:26367) IO: Failed to read packet header 06/12/20 07:04:33 (pid:26367) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 07:04:33 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 07:05:34 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 08:14:54 (pid:26367) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 08:14:54 (pid:26367) IO: Failed to read packet header 06/12/20 08:14:54 (pid:26367) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 08:16:01 (pid:26367) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 08:16:01 (pid:26367) IO: Failed to read packet header 06/12/20 08:16:01 (pid:26367) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 08:16:01 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:17:34 (pid:26367) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 08:17:34 (pid:26367) ERROR: AUTHENTICATE:1006:exceeded 1591946250 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:17:34 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:19:18 (pid:26367) SECMAN: enable_mac has no key to use, failing... 06/12/20 08:19:18 (pid:26367) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:19:18 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:20:27 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 08:21:51 (pid:26367) Accepted request to reconnect from <:0> 06/12/20 08:21:51 (pid:26367) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 08:21:51 (pid:26367) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 08:21:51 (pid:26367) Recovered connection to shadow after 417 seconds 06/12/20 08:37:58 (pid:26367) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 08:37:58 (pid:26367) IO: Failed to read packet header 06/12/20 08:37:58 (pid:26367) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 08:37:58 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:39:38 (pid:26367) SECMAN: enable_mac has no key to use, failing... 06/12/20 08:39:38 (pid:26367) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:39:38 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:39:57 (pid:26367) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> on <137.138.52.94:8636> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3716216_1b48_13>. 06/12/20 08:39:57 (pid:26367) IO: Failed to read packet header 06/12/20 08:39:57 (pid:26367) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 08:41:16 (pid:26367) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 08:41:16 (pid:26367) ERROR: AUTHENTICATE:1006:exceeded 1591947667 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:41:16 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:42:52 (pid:26367) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 08:42:52 (pid:26367) ERROR: AUTHENTICATE:1006:exceeded 1591947766 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:42:52 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:44:11 (pid:26367) condor_read() failed: recv() 5 bytes from collector vocms0840.cern.ch returned -1, timeout=300, errno=104 Connection reset by peer. 06/12/20 08:44:11 (pid:26367) IO: Failed to read packet header 06/12/20 08:44:11 (pid:26367) SECMAN: no classad from server, failing 06/12/20 08:44:11 (pid:26367) ERROR: SECMAN:2007:Failed to end classad message. 06/12/20 08:44:11 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:45:55 (pid:26367) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 08:45:55 (pid:26367) ERROR: AUTHENTICATE:1006:exceeded 1591947943 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:45:55 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:47:30 (pid:26367) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 08:47:30 (pid:26367) ERROR: AUTHENTICATE:1006:exceeded 1591948042 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:47:30 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:49:20 (pid:26367) SECMAN: enable_mac has no key to use, failing... 06/12/20 08:49:20 (pid:26367) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:49:20 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:50:30 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 08:50:51 (pid:26367) Accepted request to reconnect from <:0> 06/12/20 08:50:51 (pid:26367) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 08:50:51 (pid:26367) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 08:50:51 (pid:26367) Recovered connection to shadow after 654 seconds 06/12/20 08:56:10 (pid:26367) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 08:56:10 (pid:26367) IO: Failed to read packet header 06/12/20 08:56:10 (pid:26367) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 08:56:10 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:57:50 (pid:26367) SECMAN: enable_mac has no key to use, failing... 06/12/20 08:57:50 (pid:26367) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 08:57:50 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 08:58:51 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 09:04:10 (pid:26367) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 09:04:10 (pid:26367) IO: Failed to read packet header 06/12/20 09:04:10 (pid:26367) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 09:04:10 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 09:05:59 (pid:26367) SECMAN: enable_mac has no key to use, failing... 06/12/20 09:05:59 (pid:26367) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 09:05:59 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 09:07:08 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 09:13:46 (pid:26367) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> on <137.138.52.94:1461> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3716216_1b48_27>. 06/12/20 09:13:46 (pid:26367) IO: Failed to read packet header 06/12/20 09:13:46 (pid:26367) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 09:13:48 (pid:26367) Process exited, pid=26391, status=37 06/12/20 09:13:48 (pid:26367) Returning from CStarter::JobReaper() 06/12/20 09:14:05 (pid:26367) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 09:14:05 (pid:26367) IO: Failed to read packet header 06/12/20 09:14:05 (pid:26367) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 09:14:05 (pid:26367) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 09:15:06 (pid:26367) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144374 06/12/20 09:16:39 (pid:26367) Accepted request to reconnect from <:0> 06/12/20 09:16:39 (pid:26367) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 09:16:39 (pid:26367) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 09:16:39 (pid:26367) Recovered connection to shadow after 173 seconds 06/12/20 09:16:41 (pid:26367) Job cleanup finished, now Starter is exiting 06/12/20 09:16:41 (pid:26367) **** condor_starter (condor_STARTER) pid 26367 EXITING WITH STATUS 0 06/12/20 09:16:42 (pid:3780) ****************************************************** 06/12/20 09:16:42 (pid:3780) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 09:16:42 (pid:3780) ** /usr/sbin/condor_starter 06/12/20 09:16:42 (pid:3780) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 09:16:42 (pid:3780) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 09:16:42 (pid:3780) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 09:16:42 (pid:3780) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 09:16:42 (pid:3780) ** PID = 3780 06/12/20 09:16:42 (pid:3780) ** Log last touched 6/12 09:16:41 06/12/20 09:16:42 (pid:3780) ****************************************************** 06/12/20 09:16:42 (pid:3780) Using config source: /etc/condor/condor_config 06/12/20 09:16:42 (pid:3780) Using local config sources: 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/10_security.config 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/14_network.config 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/20_workernode.config 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/30_lease.config 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/35_cms.config 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/40_ccb.config 06/12/20 09:16:42 (pid:3780) /etc/condor/config.d/62-benchmark.conf 06/12/20 09:16:42 (pid:3780) /etc/condor/condor_config.local 06/12/20 09:16:42 (pid:3780) config Macros = 172, Sorted = 172, StringBytes = 6934, TablesBytes = 6296 06/12/20 09:16:42 (pid:3780) CLASSAD_CACHING is OFF 06/12/20 09:16:42 (pid:3780) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 09:16:42 (pid:3780) Daemoncore: Listening at <10.0.2.15:38009> on TCP (ReliSock). 06/12/20 09:16:42 (pid:3780) DaemonCore: command socket at <10.0.2.15:38009?addrs=10.0.2.15-38009&noUDP> 06/12/20 09:16:42 (pid:3780) DaemonCore: private command socket at <10.0.2.15:38009?addrs=10.0.2.15-38009> 06/12/20 09:16:51 (pid:3780) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144660 06/12/20 09:16:52 (pid:3780) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 09:16:52 (pid:3780) Submitting machine is "vocms0267.cern.ch" 06/12/20 09:16:52 (pid:3780) setting the orig job name in starter 06/12/20 09:16:52 (pid:3780) setting the orig job iwd in starter 06/12/20 09:16:52 (pid:3780) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 09:16:52 (pid:3780) Initialized IO Proxy. 06/12/20 09:16:52 (pid:3780) Done setting resource limits 06/12/20 09:16:54 (pid:3780) File transfer completed successfully. 06/12/20 09:16:55 (pid:3780) Job 298874.0 set to execute immediately 06/12/20 09:16:55 (pid:3780) Starting a VANILLA universe job with ID: 298874.0 06/12/20 09:16:55 (pid:3780) IWD: /var/lib/condor/execute/dir_3780 06/12/20 09:16:55 (pid:3780) Output file: /var/lib/condor/execute/dir_3780/_condor_stdout 06/12/20 09:16:55 (pid:3780) Error file: /var/lib/condor/execute/dir_3780/_condor_stderr 06/12/20 09:16:55 (pid:3780) Renice expr "10" evaluated to 10 06/12/20 09:16:55 (pid:3780) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_3780/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200606_004719_6021-Sandbox.tar.bz2 12300 2 06/12/20 09:16:55 (pid:3780) Running job as user nobody 06/12/20 09:16:55 (pid:3780) Create_Process succeeded, pid=3794 06/12/20 09:57:27 (pid:3780) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 09:57:27 (pid:3780) IO: Failed to read packet header 06/12/20 09:57:27 (pid:3780) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 09:58:34 (pid:3780) Accepted request to reconnect from <:0> 06/12/20 09:58:34 (pid:3780) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 09:58:34 (pid:3780) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> 06/12/20 09:58:34 (pid:3780) Recovered connection to shadow after 67 seconds 06/12/20 10:03:54 (pid:3780) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 10:03:54 (pid:3780) IO: Failed to read packet header 06/12/20 10:03:54 (pid:3780) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 10:03:54 (pid:3780) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 10:04:54 (pid:3780) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144660 06/12/20 10:25:13 (pid:3780) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 10:25:13 (pid:3780) IO: Failed to read packet header 06/12/20 10:25:13 (pid:3780) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 10:25:13 (pid:3780) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 10:26:14 (pid:3780) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144660 06/12/20 10:45:20 (pid:3780) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15792> on <137.138.52.94:23069> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3716216_1b48_40>. 06/12/20 10:45:20 (pid:3780) IO: Failed to read packet header 06/12/20 10:45:20 (pid:3780) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 10:48:31 (pid:3780) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 10:48:31 (pid:3780) IO: Failed to read packet header 06/12/20 10:48:31 (pid:3780) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 10:48:31 (pid:3780) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 10:49:54 (pid:3780) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 10:49:54 (pid:3780) ERROR: AUTHENTICATE:1006:exceeded 1591955394 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 10:49:54 (pid:3780) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 10:51:24 (pid:3780) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144660 06/12/20 11:05:20 (pid:3780) No reconnect from shadow for 1200 seconds, aborting job execution! 06/12/20 11:05:20 (pid:3780) ShutdownFast all jobs. 06/12/20 11:05:20 (pid:3780) Process exited, pid=3794, signal=9 06/12/20 11:05:20 (pid:3780) Failed to send job exit status to shadow 06/12/20 11:05:20 (pid:3780) Last process exited, now Starter is exiting 06/12/20 11:05:20 (pid:3780) **** condor_starter (condor_STARTER) pid 3780 EXITING WITH STATUS 2 06/12/20 11:06:11 (pid:11541) ****************************************************** 06/12/20 11:06:11 (pid:11541) ** condor_starter (CONDOR_STARTER) STARTING UP 06/12/20 11:06:11 (pid:11541) ** /usr/sbin/condor_starter 06/12/20 11:06:11 (pid:11541) ** SubsystemInfo: name=STARTER type=STARTER(8) class=DAEMON(1) 06/12/20 11:06:11 (pid:11541) ** Configuration: subsystem:STARTER local: class:DAEMON 06/12/20 11:06:11 (pid:11541) ** $CondorVersion: 8.6.10 Mar 12 2018 BuildID: 435200 $ 06/12/20 11:06:11 (pid:11541) ** $CondorPlatform: x86_64_RedHat6 $ 06/12/20 11:06:11 (pid:11541) ** PID = 11541 06/12/20 11:06:11 (pid:11541) ** Log last touched 6/12 11:05:20 06/12/20 11:06:11 (pid:11541) ****************************************************** 06/12/20 11:06:11 (pid:11541) Using config source: /etc/condor/condor_config 06/12/20 11:06:11 (pid:11541) Using local config sources: 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/10_security.config 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/14_network.config 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/20_workernode.config 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/30_lease.config 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/35_cms.config 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/40_ccb.config 06/12/20 11:06:11 (pid:11541) /etc/condor/config.d/62-benchmark.conf 06/12/20 11:06:11 (pid:11541) /etc/condor/condor_config.local 06/12/20 11:06:11 (pid:11541) config Macros = 172, Sorted = 172, StringBytes = 6936, TablesBytes = 6296 06/12/20 11:06:11 (pid:11541) CLASSAD_CACHING is OFF 06/12/20 11:06:11 (pid:11541) Daemon Log is logging: D_ALWAYS D_ERROR 06/12/20 11:06:11 (pid:11541) Daemoncore: Listening at <10.0.2.15:32989> on TCP (ReliSock). 06/12/20 11:06:11 (pid:11541) DaemonCore: command socket at <10.0.2.15:32989?addrs=10.0.2.15-32989&noUDP> 06/12/20 11:06:11 (pid:11541) DaemonCore: private command socket at <10.0.2.15:32989?addrs=10.0.2.15-32989> 06/12/20 11:06:41 (pid:11541) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144893 06/12/20 11:06:41 (pid:11541) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 11:06:41 (pid:11541) Submitting machine is "137.138.52.94" 06/12/20 11:06:41 (pid:11541) setting the orig job name in starter 06/12/20 11:06:41 (pid:11541) setting the orig job iwd in starter 06/12/20 11:06:41 (pid:11541) Chirp config summary: IO false, Updates false, Delayed updates true. 06/12/20 11:06:41 (pid:11541) Initialized IO Proxy. 06/12/20 11:06:41 (pid:11541) Done setting resource limits 06/12/20 11:06:46 (pid:11541) File transfer completed successfully. 06/12/20 11:06:46 (pid:11541) Job 298506.3 set to execute immediately 06/12/20 11:06:46 (pid:11541) Starting a VANILLA universe job with ID: 298506.3 06/12/20 11:06:46 (pid:11541) IWD: /var/lib/condor/execute/dir_11541 06/12/20 11:06:46 (pid:11541) Output file: /var/lib/condor/execute/dir_11541/_condor_stdout 06/12/20 11:06:46 (pid:11541) Error file: /var/lib/condor/execute/dir_11541/_condor_stderr 06/12/20 11:06:47 (pid:11541) Renice expr "10" evaluated to 10 06/12/20 11:06:47 (pid:11541) Using wrapper /usr/local/bin/singularity_wrapper.sh to exec /var/lib/condor/execute/dir_11541/condor_exec.exe ireid_TC_SLC7_IDR_CMS_Home_200609_004711_8276-Sandbox.tar.bz2 19639 0 06/12/20 11:06:47 (pid:11541) Running job as user nobody 06/12/20 11:06:47 (pid:11541) Create_Process succeeded, pid=11575 06/12/20 11:52:17 (pid:11541) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from <137.138.52.94:4080>. 06/12/20 11:52:17 (pid:11541) IO: Failed to read packet header 06/12/20 11:52:17 (pid:11541) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 11:53:24 (pid:11541) Accepted request to reconnect from <:0> 06/12/20 11:53:24 (pid:11541) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 11:53:24 (pid:11541) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 11:53:24 (pid:11541) Recovered connection to shadow after 67 seconds 06/12/20 12:12:31 (pid:11541) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> on <137.138.52.94:20214> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3762792_1cae_3>. 06/12/20 12:12:31 (pid:11541) IO: Failed to read packet header 06/12/20 12:12:31 (pid:11541) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 12:13:26 (pid:11541) Accepted request to reconnect from <:0> 06/12/20 12:13:26 (pid:11541) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 12:13:26 (pid:11541) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 12:13:26 (pid:11541) Recovered connection to shadow after 55 seconds 06/12/20 12:22:20 (pid:11541) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> on <137.138.52.94:14841> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3762792_1cae_5>. 06/12/20 12:22:20 (pid:11541) IO: Failed to read packet header 06/12/20 12:22:20 (pid:11541) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 12:26:50 (pid:11541) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 12:26:50 (pid:11541) IO: Failed to read packet header 06/12/20 12:26:50 (pid:11541) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 12:26:50 (pid:11541) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 12:28:34 (pid:11541) SECMAN: enable_mac has no key to use, failing... 06/12/20 12:28:34 (pid:11541) ERROR: SECMAN:2006:Failed to establish a crypto key.|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 12:28:34 (pid:11541) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 12:29:53 (pid:11541) condor_read() failed: recv() 5 bytes from collector vocms0840.cern.ch returned -1, timeout=300, errno=104 Connection reset by peer. 06/12/20 12:29:53 (pid:11541) IO: Failed to read packet header 06/12/20 12:29:53 (pid:11541) SECMAN: no classad from server, failing 06/12/20 12:29:53 (pid:11541) ERROR: SECMAN:2007:Failed to end classad message. 06/12/20 12:29:53 (pid:11541) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 12:31:42 (pid:11541) condor_read(): timeout reading 5 bytes from collector vocms0840.cern.ch. 06/12/20 12:31:42 (pid:11541) IO: Failed to read packet header 06/12/20 12:31:42 (pid:11541) SECMAN: required authentication with collector vocms0840.cern.ch failed, so aborting command CCB_REGISTER. 06/12/20 12:31:42 (pid:11541) ERROR: AUTHENTICATE:1006:exceeded 1591961490 deadline during authentication|AUTHENTICATE:1004:Failed to authenticate using FS 06/12/20 12:31:42 (pid:11541) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 12:32:49 (pid:11541) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144893 06/12/20 12:35:01 (pid:11541) Accepted request to reconnect from <:0> 06/12/20 12:35:01 (pid:11541) Ignoring old shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 12:35:01 (pid:11541) Communicating with shadow <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> 06/12/20 12:35:01 (pid:11541) Recovered connection to shadow after 761 seconds 06/12/20 12:40:20 (pid:11541) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 12:40:20 (pid:11541) IO: Failed to read packet header 06/12/20 12:40:20 (pid:11541) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 12:40:20 (pid:11541) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 12:41:21 (pid:11541) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144893 06/12/20 12:51:40 (pid:11541) condor_read() failed: recv(fd=10) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from collector vocms0840.cern.ch. 06/12/20 12:51:40 (pid:11541) IO: Failed to read packet header 06/12/20 12:51:40 (pid:11541) CCBListener: failed to receive message from CCB server vocms0840.cern.ch 06/12/20 12:51:40 (pid:11541) CCBListener: connection to CCB server vocms0840.cern.ch failed; will try to reconnect in 60 seconds. 06/12/20 12:55:18 (pid:11541) condor_read() failed: recv(fd=11) returned -1, errno = 104 Connection reset by peer, reading 21 bytes from SHADOW <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_2424955_eb4b_15969> on <137.138.52.94:14938> with reverse connect address <137.138.52.94:4080?addrs=137.138.52.94-4080&alias=vocms0267.cern.ch&noUDP&sock=shadow_3762792_1cae_18>. 06/12/20 12:55:18 (pid:11541) IO: Failed to read packet header 06/12/20 12:55:18 (pid:11541) Lost connection to shadow, waiting 1200 secs for reconnect 06/12/20 12:55:19 (pid:11541) CCBListener: registered with CCB server vocms0840.cern.ch as ccbid 137.138.156.85:9618?addrs=137.138.156.85-9618#2144893 06/12/20 13:15:19 (pid:11541) No reconnect from shadow for 1201 seconds, aborting job execution! 06/12/20 13:15:19 (pid:11541) ShutdownFast all jobs. 06/12/20 13:15:19 (pid:11541) Process exited, pid=11575, signal=9 06/12/20 13:15:19 (pid:11541) Failed to send job exit status to shadow 06/12/20 13:15:19 (pid:11541) Last process exited, now Starter is exiting 06/12/20 13:15:19 (pid:11541) **** condor_starter (condor_STARTER) pid 11541 EXITING WITH STATUS 2