Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug] [Module Name] Bug title dinky can't submit flink sql to yarn application #3963

Closed
3 tasks done
laaboo666 opened this issue Nov 27, 2024 · 3 comments
Closed
3 tasks done

[Bug] [Module Name] Bug title dinky can't submit flink sql to yarn application #3963

laaboo666 opened this issue Nov 27, 2024 · 3 comments
Assignees
@Zzm0809
Labels
Bug Something isn't working

Comments

@laaboo666
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

I installed dinky1.0 correctly, uploaded dinky/jar to hdfs, and uploaded flink/lib to hdfs. According to the requirements of the official website, I also uploaded flink-shaded-hadoop-3-uber-3.1.1.7.2.1.0-327-9.0.jar
hdfs

dinky

After I successfully registered the yarn application cluster, I tried to submit a flink sql insert job to the yarn application using hivecatalog but failed
application

flink 1.17
dinky 1.0.0
hadoop 3.3.6

!!!First summit !!!
:
[dinky] 2024-11-27 11:50:12 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: c9d3a979-72fe-4eaa-91eb-1bd540def440，replace it
[dinky] 2024-11-27 11:50:13 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: efa5d9e5-6d19-4eba-b617-2c68fe752ea8，replace it
[dinky] 2024-11-27 11:50:15 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 296c00fd-61d3-43e9-bdb1-6a99da8a50b4，replace it
[dinky] 2024-11-27 11:50:25 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 11:50:25 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [296c00fd-61d3-43e9-bdb1-6a99da8a50b4] Error, Message: 断开的管道
[dinky] 2024-11-27 11:50:25 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [296c00fd-61d3-43e9-bdb1-6a99da8a50b4] Error, Message: java.io.IOException: 断开的管道
[dinky] 2024-11-27 11:50:25 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 55fe9a86-4f7e-4874-a7fd-f0613b3d3091，replace it
[dinky] 2024-11-27 11:50:55 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 11:50:55 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [55fe9a86-4f7e-4874-a7fd-f0613b3d3091] Error, Message: 断开的管道
[dinky] 2024-11-27 11:50:55 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [55fe9a86-4f7e-4874-a7fd-f0613b3d3091] Error, Message: java.io.IOException: 断开的管道
[dinky] 2024-11-27 11:51:58 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 32951bde-ab0f-487e-9d99-8069c2b46d80，replace it
[dinky] 2024-11-27 11:52:02 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: d375827b-2bfc-4c1b-96fc-fc7d7e0745a4，replace it
[dinky] 2024-11-27 11:52:03 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: dd51bf90-d5ab-4101-8435-cc61218c99e3，replace it
[dinky] 2024-11-27 11:52:24 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 11:52:24 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [dd51bf90-d5ab-4101-8435-cc61218c99e3] Error, Message: 断开的管道
[dinky] 2024-11-27 11:52:24 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [dd51bf90-d5ab-4101-8435-cc61218c99e3] Error, Message: java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:02:04 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: d375827b-2bfc-4c1b-96fc-fc7d7e0745a4，replace it
[dinky] 2024-11-27 12:04:35 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 69dda00d-d615-42cb-b4c2-189b67e23201，replace it
[dinky] 2024-11-27 12:04:43 CST INFO org.dinky.service.impl.TaskServiceImpl 177 prepareTask - Start check and config task, task:dim insert
[dinky] 2024-11-27 12:04:43 CST INFO org.dinky.service.impl.TaskServiceImpl 286 buildEnvSql - Start initialize FlinkSQLEnv:
[dinky] 2024-11-27 12:04:43 CST INFO org.dinky.service.impl.TaskServiceImpl 306 buildEnvSql - Initializing data permissions...
[dinky] 2024-11-27 12:04:43 CST INFO org.dinky.service.impl.TaskServiceImpl 308 buildEnvSql - Finish initialize FlinkSQLEnv.
[dinky] 2024-11-27 12:04:43 CST INFO org.dinky.service.impl.TaskServiceImpl 223 buildJobSubmitConfig - Init gateway config, type:yarn-application
[dinky] 2024-11-27 12:04:43 CST INFO org.dinky.service.impl.TaskServiceImpl 236 buildJobSubmitConfig - Init remote cluster
[dinky] 2024-11-27 12:04:43 CST ERROR org.dinky.aop.exception.UnKnownExceptionHandler 39 unknownException - cn.hutool.core.exceptions.UtilException: Instance class [class org.dinky.service.task.FlinkSqlTask] error! org.dinky.data.exception.DinkyException: cn.hutool.core.exceptions.UtilException: Instance class [class org.dinky.service.task.FlinkSqlTask] error!
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:58) ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.GeneratedMethodAccessor192.invoke(Unknown Source) ~[?:?]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$280e2728.submitTask() ~[dinky-admin-1.0.0.jar:?]
at org.dinky.controller.TaskController.submitTask(TaskController.java:80) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.controller.TaskController$$FastClassBySpringCGLIB$$5b68bd32.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.ProcessAspect.processAround(ProcessAspect.java:73) ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AspectJAfterThrowingAdvice.invoke(AspectJAfterThrowingAdvice.java:64) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.controller.TaskController$$EnhancerBySpringCGLIB$$2ca4aba0.submitTask() ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205) ~[spring-web-5.3.27.jar:5.3.27]
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150) ~[spring-web-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1072) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:965) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006) ~[spring-webmvc-5.3.27.jar:5.3.27]
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:898) ~[spring-webmvc-5.3.27.jar:5.3.27]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:529) ~[tomcat-embed-core-9.0.74.jar:4.0.FR]
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883) ~[spring-webmvc-5.3.27.jar:5.3.27]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:623) ~[tomcat-embed-core-9.0.74.jar:4.0.FR]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:209) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:51) ~[tomcat-embed-websocket-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.springframework.web.filter.CorsFilter.doFilterInternal(CorsFilter.java:91) ~[spring-web-5.3.27.jar:5.3.27]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.27.jar:5.3.27]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:124) ~[druid-1.2.8.jar:1.2.8]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100) ~[spring-web-5.3.27.jar:5.3.27]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.27.jar:5.3.27]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at cn.dev33.satoken.filter.SaPathCheckFilterForServlet.doFilter(SaPathCheckFilterForServlet.java:55) ~[sa-token-spring-boot-starter-1.37.0.jar:?]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93) ~[spring-web-5.3.27.jar:5.3.27]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.27.jar:5.3.27]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:96) ~[spring-boot-actuator-2.7.11.jar:2.7.11]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.27.jar:5.3.27]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201) ~[spring-web-5.3.27.jar:5.3.27]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117) ~[spring-web-5.3.27.jar:5.3.27]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:178) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:153) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:167) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:90) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:481) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:130) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:93) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:389) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:63) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:926) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1791) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:52) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) ~[tomcat-embed-core-9.0.74.jar:9.0.74]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_202]
Caused by: cn.hutool.core.exceptions.UtilException: Instance class [class org.dinky.service.task.FlinkSqlTask] error!
at cn.hutool.core.util.ReflectUtil.newInstance(ReflectUtil.java:875) ~[hutool-all-5.8.25.jar:5.8.25]
at org.dinky.service.task.BaseTask.getTask(BaseTask.java:73) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:191) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.ProcessAspect.processStepAround(ProcessAspect.java:110) ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$280e2728.executeJob() ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:319) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:55) ~[dinky-admin-1.0.0.jar:?]
... 108 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_202]
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_202]
at cn.hutool.core.util.ReflectUtil.newInstance(ReflectUtil.java:873) ~[hutool-all-5.8.25.jar:5.8.25]
at org.dinky.service.task.BaseTask.getTask(BaseTask.java:73) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:191) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.ProcessAspect.processStepAround(ProcessAspect.java:110) ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$280e2728.executeJob() ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:319) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:55) ~[dinky-admin-1.0.0.jar:?]
... 108 more
Caused by: java.lang.NoClassDefFoundError: org/dinky/executor/CustomTableEnvironmentImpl
at org.dinky.executor.LocalStreamExecutor.createCustomTableEnvironment(LocalStreamExecutor.java:72) ~[dinky-core-1.0.0.jar:?]
at org.dinky.executor.Executor.init(Executor.java:160) ~[dinky-core-1.0.0.jar:?]
at org.dinky.executor.LocalStreamExecutor.(LocalStreamExecutor.java:67) ~[dinky-core-1.0.0.jar:?]
at org.dinky.executor.ExecutorFactory.buildLocalExecutor(ExecutorFactory.java:52) ~[dinky-core-1.0.0.jar:?]
at org.dinky.executor.ExecutorFactory.buildExecutor(ExecutorFactory.java:44) ~[dinky-core-1.0.0.jar:?]
at org.dinky.job.JobManager.init(JobManager.java:219) ~[dinky-core-1.0.0.jar:?]
at org.dinky.job.JobManager.build(JobManager.java:197) ~[dinky-core-1.0.0.jar:?]
at org.dinky.service.task.FlinkSqlTask.getJobManager(FlinkSqlTask.java:73) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.task.FlinkSqlTask.(FlinkSqlTask.java:52) ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:1.8.0_202]
at java.lang.reflect.Constructor.newInstance(Constructor.java:423) ~[?:1.8.0_202]
at cn.hutool.core.util.ReflectUtil.newInstance(ReflectUtil.java:873) ~[hutool-all-5.8.25.jar:5.8.25]
at org.dinky.service.task.BaseTask.getTask(BaseTask.java:73) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl.executeJob(TaskServiceImpl.java:191) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.ProcessAspect.processStepAround(ProcessAspect.java:110) ~[dinky-admin-1.0.0.jar:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_202]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_202]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_202]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_202]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$280e2728.executeJob() ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:319) ~[dinky-admin-1.0.0.jar:?]
at org.dinky.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$22087f7c.invoke() ~[dinky-admin-1.0.0.jar:?]
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218) ~[spring-core-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763) ~[spring-aop-5.3.27.jar:5.3.27]
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89) ~[spring-aop-5.3.27.jar:5.3.27]
at org.dinky.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:55) ~[dinky-admin-1.0.0.jar:?]
... 108 more

When I submitted the second time, I only had the following log
:
[dinky] 2024-11-27 12:05:05 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:05:05 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [69dda00d-d615-42cb-b4c2-189b67e23201] Error, Message: java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:05:05 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [69dda00d-d615-42cb-b4c2-189b67e23201] Error, Message: 断开的管道
[dinky] 2024-11-27 12:05:44 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 037e6117-345d-4363-be10-6c7e0e6c85af，replace it
[dinky] 2024-11-27 12:05:53 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 714863f0-53e5-44e3-841f-8d71cababced，replace it
[dinky] 2024-11-27 12:06:13 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: b10bd4c6-3846-40dc-943c-0403a6e3dd3e，replace it
[dinky] 2024-11-27 12:07:01 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 62f88619-9eda-4a3e-898b-eb05081ee746，replace it
[dinky] 2024-11-27 12:07:08 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: be9d35f9-328c-42de-a9b5-8c62f76f0cd8，replace it
[dinky] 2024-11-27 12:07:10 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 324f8f8f-b098-4c0c-8c32-f9ab1b74a22f，replace it
[dinky] 2024-11-27 12:07:18 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:07:18 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [be9d35f9-328c-42de-a9b5-8c62f76f0cd8] Error, Message: java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:07:18 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [be9d35f9-328c-42de-a9b5-8c62f76f0cd8] Error, Message: 断开的管道
[dinky] 2024-11-27 12:07:40 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 58f392ce-9e5a-4ed6-b860-ee0b5da3f870，replace it
[dinky] 2024-11-27 12:15:39 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: b91afc27-fb61-4ea1-85c9-2030cce2afdb，replace it
[dinky] 2024-11-27 12:17:42 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 58f392ce-9e5a-4ed6-b860-ee0b5da3f870，replace it
[dinky] 2024-11-27 12:19:33 CST INFO org.springframework.web.socket.config.WebSocketMessageBrokerStats 128 lambda$initLoggingTask$0 - WebSocketSession[0 current WS(0)-HttpStream(0)-HttpPoll(0), 0 total, 0 closed abnormally (0 connect failure, 0 send limit, 0 transport error)], stompSubProtocol[processed CONNECT(0)-CONNECTED(0)-DISCONNECT(0)], stompBrokerRelay[null], inboundChannel[pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], outboundChannel[pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 0], sockJsScheduler[pool size = 2, active threads = 1, queued tasks = 0, completed tasks = 1]
[dinky] 2024-11-27 12:20:19 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:20:19 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [b91afc27-fb61-4ea1-85c9-2030cce2afdb] Error, Message: 断开的管道
[dinky] 2024-11-27 12:20:19 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [b91afc27-fb61-4ea1-85c9-2030cce2afdb] Error, Message: java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:21:20 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 2b6f6996-0e26-4a72-98f9-fbd2e873c2fd，replace it
[dinky] 2024-11-27 12:21:21 CST WARN org.dinky.context.SseSessionContextHolder 70 connectSession - Session key already exists: 18838dcd-1843-46a3-b1dc-8bb5e90150c4，replace it
[dinky] 2024-11-27 12:21:31 CST ERROR org.dinky.context.SseSessionContextHolder 164 lambda$sendTopic$3 - Error sending sse data:java.io.IOException: 断开的管道
[dinky] 2024-11-27 12:21:31 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [18838dcd-1843-46a3-b1dc-8bb5e90150c4] Error, Message: 断开的管道
[dinky] 2024-11-27 12:21:31 CST ERROR org.dinky.context.SseSessionContextHolder 130 onError - Type: SseSession [18838dcd-1843-46a3-b1dc-8bb5e90150c4] Error, Message: java.io.IOException: 断开的管道

What's even weirder is that every time I submit an assignment, the submit history doesn't have any output

image

What you expected to happen

I don't know what went wrong

How to reproduce

I followed the steps exactly on the website.

Anything else

nothing else

Version

1.0.3

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@laaboo666 laaboo666 added Bug Something isn't working Waiting for reply Waiting for reply labels Nov 27, 2024
@github-actions GitHub Actions
Copy link

Hello @laaboo666, this issue is about web, so I assign it to @Zzm0809. If you have any questions, you can comment and reply.

你好 @laaboo666, 这个 issue 是关于 web 的，所以我把它分配给了 @Zzm0809。如有任何问题，可以评论回复。

@aiwenmo aiwenmo removed the Waiting for reply Waiting for reply label Nov 27, 2024
@laaboo666
Copy link
Author

laaboo666 commented Nov 28, 2024 •
edited
Loading

我使用dlink 0.7.3 . 注册yarn application 集群 。提交flink sql insert 作业到yarn application。能够创建container 但是很快就killed了。报错信息没有任何异常

yarn 日志

-rw-r--r-- 1 root root 69 11月 28 13:03 container_tokens
-rwx------ 1 root root 704 11月 28 13:03 default_container_executor_session.sh
-rwx------ 1 root root 759 11月 28 13:03 default_container_executor.sh
lrwxrwxrwx 1 root root 153 11月 28 13:03 dlink-app-1.17-0.7.3-jar-with-dependencies.jar -> /export/data/hadoop-3.3.6/nm-local-dir/usercache/root/appcache/application_1732762106647_0001/filecache/12/dlink-app-1.17-0.7.3-jar-with-dependencies.jar
lrwxrwxrwx 1 root root 176 11月 28 13:03 flink-conf.yaml -> /export/data/hadoop-3.3.6/nm-local-dir/usercache/root/appcache/application_1732762106647_0001/filecache/11/application_1732762106647_0001-flink-conf.yaml3711091257505982140.tmp
-rwx------ 1 root root 16250 11月 28 13:03 launch_container.sh
drwxr-xr-x 2 root root 4096 11月 28 13:03 lib
lrwxrwxrwx 1 root root 123 11月 28 13:03 log4j.properties -> /export/data/hadoop-3.3.6/nm-local-dir/usercache/root/appcache/application_1732762106647_0001/filecache/10/log4j.properties
drwx--x--- 2 root root 6 11月 28 13:03 tmp
find -L . -maxdepth 5 -ls:
269939118 4 drwx--x--- 4 root root 4096 11月 28 13:03 .
1630235 0 drwx--x--- 2 root root 6 11月 28 13:03 ./tmp
269939120 4 -rw-r--r-- 1 root root 69 11月 28 13:03 ./container_tokens
269939143 4 -rw-r--r-- 1 root root 12 11月 28 13:03 ./.container_tokens.crc
269939144 16 -rwx------ 1 root root 16250 11月 28 13:03 ./launch_container.sh
269939145 4 -rw-r--r-- 1 root root 136 11月 28 13:03 ./.launch_container.sh.crc
269939146 4 -rwx------ 1 root root 704 11月 28 13:03 ./default_container_executor_session.sh
269939147 4 -rw-r--r-- 1 root root 16 11月 28 13:03 ./.default_container_executor_session.sh.crc
269939148 4 -rwx------ 1 root root 759 11月 28 13:03 ./default_container_executor.sh
269939149 4 -rw-r--r-- 1 root root 16 11月 28 13:03 ./.default_container_executor.sh.crc
136503608 4 drwxr-xr-x 2 root root 4096 11月 28 13:03 ./lib
269939135 132784 -r-xr-xr-x 1 root root 135969953 11月 28 13:03 ./lib/flink-dist-1.17.0.jar
136503597 296 -r-xr-xr-x 1 root root 301872 11月 28 13:02 ./lib/log4j-api-2.17.1.jar
1630229 264 -r-xr-xr-x 1 root root 268555 11月 28 13:02 ./lib/flink-connector-jdbc-3.1.2-1.17.jar
406935855 15048 -r-xr-xr-x 1 root root 15407474 11月 28 13:02 ./lib/flink-table-api-java-uber-1.17.0.jar
406935861 93148 -r-xr-xr-x 1 root root 95381861 11月 28 13:03 ./lib/hudi-flink1.17-bundle-0.14.1.jar
406935867 20552 -r-xr-xr-x 1 root root 21043313 11月 28 13:03 ./lib/flink-scala_2.12-1.17.0.jar
136503591 12008 -r-xr-xr-x 1 root root 12295299 11月 28 13:02 ./lib/flink-doris-connector-1.17-1.6.2.jar
269939132 204 -r-xr-xr-x 1 root root 208006 11月 28 13:02 ./lib/log4j-1.2-api-2.17.1.jar
1630226 5436 -r-xr-xr-x 1 root root 5563429 11月 28 13:02 ./lib/flink-sql-connector-kafka-1.17.0.jar
269939141 50136 -r-xr-xr-x 1 root root 51337478 11月 28 13:03 ./lib/flink-sql-connector-hive-3.1.3_2.12-1.17.0.jar
1630216 57004 -r-xr-xr-x 1 root root 58371303 11月 28 13:02 ./lib/flink-shaded-hadoop-3-uber-3.1.1.7.2.1.0-327-9.0.jar
136503584 2460 -r-xr-xr-x 1 root root 2515447 11月 28 13:02 ./lib/mysql-connector-j-8.0.31.jar
269939138 532 -r-xr-xr-x 1 root root 542616 11月 28 13:02 ./lib/flink-connector-files-1.17.0.jar
136503600 192 -r-xr-xr-x 1 root root 196487 11月 28 13:02 ./lib/flink-cep-1.17.0.jar
136503594 3076 -r-xr-xr-x 1 root root 3146205 11月 28 13:02 ./lib/flink-table-runtime-1.17.0.jar
406935873 180 -r-xr-xr-x 1 root root 180243 11月 28 13:03 ./lib/flink-json-1.17.0.jar
1630220 24 -r-xr-xr-x 1 root root 24279 11月 28 13:02 ./lib/log4j-slf4j-impl-2.17.1.jar
1630232 1752 -r-xr-xr-x 1 root root 1790452 11月 28 13:02 ./lib/log4j-core-2.17.1.jar
406935870 104 -r-xr-xr-x 1 root root 102468 11月 28 13:02 ./lib/flink-csv-1.17.0.jar
269939121 22432 -r-xr-xr-x 1 root root 22968127 11月 28 13:02 ./lib/flink-sql-connector-mysql-cdc-2.3.0.jar
406935864 60 -r-xr-xr-x 1 root root 59528 11月 28 13:02 ./lib/commons-cli-1.6.0.jar
269939129 20580 -r-xr-xr-x 1 root root 21072371 11月 28 13:02 ./lib/flink-table-planner_2.12-1.17.0.jar
136503588 4 -r-x------ 1 root root 1555 11月 28 13:02 ./flink-conf.yaml
1630223 20140 -r-x------ 1 root root 20620010 11月 28 13:02 ./dlink-app-1.17-0.7.3-jar-with-dependencies.jar
406935858 4 -r-x------ 1 root root 2694 11月 28 13:02 ./log4j.properties
broken symlinks(find -L . -maxdepth 5 -type l -ls):

dlink日志：
java.util.concurrent.ExecutionException: org.apache.flink.util.concurrent.FutureUtils$RetryException: Could not complete the operation. Number of retries has been exhausted.
at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
at com.dlink.gateway.yarn.YarnApplicationGateway.submitJar(YarnApplicationGateway.java:118)
at com.dlink.job.JobManager.submitByGateway(JobManager.java:621)
at com.dlink.job.JobManager.executeSql(JobManager.java:437)
at com.dlink.service.impl.TaskServiceImpl.submitTask(TaskServiceImpl.java:251)
at com.dlink.service.impl.TaskServiceImpl$$FastClassBySpringCGLIB$$168bea78.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)
at com.dlink.aop.UdfClassLoaderAspect.round(UdfClassLoaderAspect.java:65)
at sun.reflect.GeneratedMethodAccessor179.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)
at com.dlink.service.impl.TaskServiceImpl$$EnhancerBySpringCGLIB$$ef231733.submitTask()
at com.dlink.controller.TaskController.submit(TaskController.java:127)
at com.dlink.controller.TaskController$$FastClassBySpringCGLIB$$a86993b6.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:793)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
at org.springframework.aop.framework.adapter.AfterReturningAdviceInterceptor.invoke(AfterReturningAdviceInterceptor.java:57)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:763)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:708)
at com.dlink.controller.TaskController$$EnhancerBySpringCGLIB$$696f980b.submit()
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:205)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:150)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:117)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:808)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1071)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:964)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1006)
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:909)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:696)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:883)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:779)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:227)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
at com.alibaba.druid.support.http.WebStatFilter.doFilter(WebStatFilter.java:124)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:100)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:93)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:201)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:117)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:189)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:162)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:197)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:97)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:135)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:78)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:360)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:399)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:893)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1789)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at org.apache.tomcat.util.threads.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1191)
at org.apache.tomcat.util.threads.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:659)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flink.util.concurrent.FutureUtils$RetryException: Could not complete the operation. Number of retries has been exhausted.
at org.apache.flink.util.concurrent.FutureUtils.lambda$retryOperationWithDelay$6(FutureUtils.java:293)
at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1977)
at org.apache.flink.runtime.rest.RestClient.lambda$submitRequest$1(RestClient.java:480)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:578)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:571)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:550)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:491)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:616)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.setFailure0(DefaultPromise.java:609)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.DefaultPromise.tryFailure(DefaultPromise.java:117)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.fulfillConnectPromise(AbstractNioChannel.java:321)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:337)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
... 1 more
Caused by: java.util.concurrent.CompletionException: org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: 拒绝连接: cluster03/192.168.88.113:35476
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292)
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308)
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:943)
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:926)
... 19 more
Caused by: org.apache.flink.shaded.netty4.io.netty.channel.AbstractChannel$AnnotatedConnectException: 拒绝连接: cluster03/192.168.88.113:35476
Caused by: java.net.ConnectException: 拒绝连接
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
at org.apache.flink.shaded.netty4.io.netty.channel.socket.nio.NioSocketChannel.doFinishConnect(NioSocketChannel.java:337)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.AbstractNioChannel$AbstractNioUnsafe.finishConnect(AbstractNioChannel.java:334)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:776)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
at org.apache.flink.shaded.netty4.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
at org.apache.flink.shaded.netty4.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at org.apache.flink.shaded.netty4.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.lang.Thread.run(Thread.java:748)

我的sql：

SET execution.checkpointing.interval=30sec;

CREATE DATABASE IF NOT EXISTS dim;
USE dim;

insert into dwd_dim_base_date_f
select * from mysql_dim_base_date;

@laaboo666
Copy link
Author

问题已解决

原因是：hadoop 从节点服务器 /etc/profile 未正确配置 hadoop的LD_LIBRARY_PATH

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Zzm0809 Zzm0809

Labels
Bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@aiwenmo @Zzm0809 @laaboo666