Running driver with proxy user. Cluster manager: Kubernetes 2026-06-30 09:47:00.139Z WARN [main] [NativeCodeLoader] [P:|T:] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Files local:///opt/spark/usrlib/optimizer-job.jar from /opt/spark/usrlib/optimizer-job.jar to /opt/spark/work-dir/optimizer-job.jar 2026-06-30 09:47:01.184Z WARN [main] [SparkContext] [P:|T:] - The JAR local:///opt/spark/usrlib/optimizer-job.jar at file:/opt/spark/usrlib/optimizer-job.jar has been added already. Overwriting of added jar is not supported in the current version. 2026-06-30 09:47:02.706Z INFO [main] [OptimizerToucher] [P:|T:] - Adding register property resource-id:70tt4ot75s98aqmnsg8uqnd218 into optimizer 2026-06-30 09:47:02.706Z INFO [main] [OptimizerToucher] [P:|T:] - Adding register property resource-id:70tt4ot75s98aqmnsg8uqnd218 into optimizer 2026-06-30 09:47:02.707Z INFO [main] [OptimizerToucher] [P:|T:] - Adding register property job-id:spark-c8af46e899c34563a82612c33a908616 into optimizer 2026-06-30 09:47:02.707Z INFO [main] [OptimizerToucher] [P:|T:] - Adding register property job-id:spark-c8af46e899c34563a82612c33a908616 into optimizer 2026-06-30 09:47:02.707Z INFO [main] [SparkOptimizer] [P:|T:] - Starting the spark optimizer with configuration:OptimizerConfig{amsUrl=thrift://olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261, executionParallel=3, memorySize=13312, groupName=spark-container, heartBeat=10000, extendDiskStorage=false, diskStoragePath=null, memoryStorageSize=512, resourceId=70tt4ot75s98aqmnsg8uqnd218, cacheEnabled=false, cacheMaxTotalSize=128mb, cacheMaxEntrySize=64mb, cacheTimeout=10min} 2026-06-30 09:47:02.707Z INFO [main] [SparkOptimizer] [P:|T:] - Starting the spark optimizer with configuration:OptimizerConfig{amsUrl=thrift://olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261, executionParallel=3, memorySize=13312, groupName=spark-container, heartBeat=10000, extendDiskStorage=false, diskStoragePath=null, memoryStorageSize=512, resourceId=70tt4ot75s98aqmnsg8uqnd218, cacheEnabled=false, cacheMaxTotalSize=128mb, cacheMaxEntrySize=64mb, cacheTimeout=10min} 2026-06-30 09:47:02.709Z INFO [main] [Optimizer] [P:|T:] - Starting optimizer with configuration:OptimizerConfig{amsUrl=thrift://olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261, executionParallel=3, memorySize=13312, groupName=spark-container, heartBeat=10000, extendDiskStorage=false, diskStoragePath=null, memoryStorageSize=512, resourceId=70tt4ot75s98aqmnsg8uqnd218, cacheEnabled=false, cacheMaxTotalSize=128mb, cacheMaxEntrySize=64mb, cacheTimeout=10min} 2026-06-30 09:47:02.709Z INFO [main] [Optimizer] [P:|T:] - Starting optimizer with configuration:OptimizerConfig{amsUrl=thrift://olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261, executionParallel=3, memorySize=13312, groupName=spark-container, heartBeat=10000, extendDiskStorage=false, diskStoragePath=null, memoryStorageSize=512, resourceId=70tt4ot75s98aqmnsg8uqnd218, cacheEnabled=false, cacheMaxTotalSize=128mb, cacheMaxEntrySize=64mb, cacheTimeout=10min} 2026-06-30 09:47:02.710Z INFO [main] [OptimizerToucher] [P:|T:] - Starting optimizer toucher with configuration:OptimizerConfig{amsUrl=thrift://olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261, executionParallel=3, memorySize=13312, groupName=spark-container, heartBeat=10000, extendDiskStorage=false, diskStoragePath=null, memoryStorageSize=512, resourceId=70tt4ot75s98aqmnsg8uqnd218, cacheEnabled=false, cacheMaxTotalSize=128mb, cacheMaxEntrySize=64mb, cacheTimeout=10min} 2026-06-30 09:47:02.710Z INFO [main] [OptimizerToucher] [P:|T:] - Starting optimizer toucher with configuration:OptimizerConfig{amsUrl=thrift://olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261, executionParallel=3, memorySize=13312, groupName=spark-container, heartBeat=10000, extendDiskStorage=false, diskStoragePath=null, memoryStorageSize=512, resourceId=70tt4ot75s98aqmnsg8uqnd218, cacheEnabled=false, cacheMaxTotalSize=128mb, cacheMaxEntrySize=64mb, cacheTimeout=10min} 2026-06-30 09:47:03.784Z WARN [main] [ThriftClientPool] [P:|T:] - Transport open failed, service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:03.784Z WARN [main] [ThriftClientPool] [P:|T:] - Transport open failed, service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:03.785Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:03.785Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:04.808Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:04.808Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:06.816Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:06.816Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:07.880Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:07.880Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:09.882Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:09.882Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:10.888Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:10.888Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:12.891Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:12.891Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:13.896Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:13.896Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:15.899Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:15.899Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:16.904Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:16.904Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:18.908Z ERROR [main] [AbstractOptimizerOperator] [P:|T:] - Call ams got an error and will try again later org.apache.amoro.client.ConnectionFailException: Connected error after 5 retries, last address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:113) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:83) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 31 more Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:83) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 31 more 2026-06-30 09:47:18.908Z ERROR [main] [AbstractOptimizerOperator] [P:|T:] - Call ams got an error and will try again later org.apache.amoro.client.ConnectionFailException: Connected error after 5 retries, last address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:113) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:83) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 31 more Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:83) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 31 more 2026-06-30 09:47:24.968Z WARN [main] [ThriftClientPool] [P:|T:] - Transport open failed, service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:24.968Z WARN [main] [ThriftClientPool] [P:|T:] - Transport open failed, service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:24.968Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:24.968Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:25.992Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:25.992Z WARN [main] [ThriftClientPool] [P:|T:] - Reconnected service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 failed org.apache.amoro.shade.thrift.org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:231) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.layered.TFramedTransport.open(TFramedTransport.java:82) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:100) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool$1.create(ThriftClientPool.java:72) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.BasePooledObjectFactory.makeObject(BasePooledObjectFactory.java:71) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:566) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:306) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:233) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.ThriftClientPool.iface(ThriftClientPool.java:189) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.client.OptimizingClientPools.getClient(OptimizingClientPools.java:38) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.AbstractOptimizerOperator.callAms(AbstractOptimizerOperator.java:53) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.checkToken(OptimizerToucher.java:74) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.OptimizerToucher.start(OptimizerToucher.java:59) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.common.Optimizer.startOptimizing(Optimizer.java:65) ~[optimizer-job.jar:0.9-SNAPSHOT] at org.apache.amoro.optimizer.spark.SparkOptimizer.main(SparkOptimizer.java:69) ~[optimizer-job.jar:0.9-SNAPSHOT] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:569) ~[?:?] at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1034) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.$anonfun$submit$2(SparkSubmit.scala:174) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:62) ~[spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkHadoopUtil$$anon$1.run(SparkHadoopUtil.scala:61) ~[spark-core_2.12-3.5.8.jar:3.5.8] at java.security.AccessController.doPrivileged(AccessController.java:712) [?:?] at javax.security.auth.Subject.doAs(Subject.java:439) [?:?] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878) [hadoop-client-api-3.3.4.jar:?] at org.apache.spark.deploy.SparkHadoopUtil.runAsSparkUser(SparkHadoopUtil.scala:61) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:222) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1125) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1134) [spark-core_2.12-3.5.8.jar:3.5.8] at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) [spark-core_2.12-3.5.8.jar:3.5.8] Caused by: java.net.ConnectException: Connection refused at sun.nio.ch.Net.connect0(Native Method) ~[?:?] at sun.nio.ch.Net.connect(Net.java:579) ~[?:?] at sun.nio.ch.Net.connect(Net.java:568) ~[?:?] at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) ~[?:?] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) ~[?:?] at java.net.Socket.connect(Socket.java:633) ~[?:?] at org.apache.amoro.shade.thrift.org.apache.thrift.transport.TSocket.open(TSocket.java:226) ~[optimizer-job.jar:0.9-SNAPSHOT] ... 33 more 2026-06-30 09:47:27.994Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:27.994Z INFO [main] [ThriftClientPool] [P:|T:] - Reconnecting service address: olake-fusion-fusion-optimizing.olake-fusion.svc.cluster.local:1261 2026-06-30 09:47:28.017Z INFO [main] [OptimizerToucher] [P:|T:] - Adding register property heart-beat-interval:10000 into optimizer 2026-06-30 09:47:28.017Z INFO [main] [OptimizerToucher] [P:|T:] - Adding register property heart-beat-interval:10000 into optimizer 2026-06-30 09:47:28.038Z INFO [main] [OptimizerToucher] [P:|T:] - Registered optimizer to ams with token:618d2dfd-505a-49b8-bc4c-521ca690dbe0 2026-06-30 09:47:28.038Z INFO [main] [OptimizerToucher] [P:|T:] - Registered optimizer to ams with token:618d2dfd-505a-49b8-bc4c-521ca690dbe0