weixin_39610956
weixin_39610956
2020-11-30 10:48

Installing by Using Docker Compose - prometheus

Description: I follow Installing by Using Docker Compose to install. Always encounter prometheus error. like this:

 log
prometheus           | level=error ts=2019-07-16T11:02:00.983351716Z caller=file.go:321 component="discovery manager scrape" discovery=file msg="Error reading file" path=/etc/prometheus/targets.json err="unexpected end of JSON input"

Steps to reproduce:

 shell
wget https://raw.githubusercontent.com/spring-cloud/spring-cloud-dataflow/v2.1.2.RELEASE/spring-cloud-dataflow-server/docker-compose.yml
 shell
export DATAFLOW_VERSION=2.1.2.RELEASE
export SKIPPER_VERSION=2.0.3.RELEASE
docker-compose up

Screenshots:

 log
prometheus           | level=error ts=2019-07-16T11:02:00.983351716Z caller=file.go:321 component="discovery manager scrape" discovery=file msg="Error reading file" path=/etc/prometheus/targets.json err="unexpected end of JSON input"
 log
kafka_1              | [2019-07-16 11:01:13,803] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-18 in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,804] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-21 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,829] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-24 in 0 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,832] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-27 in 2 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,840] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-30 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,848] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-33 in 2 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,850] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-36 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,854] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-39 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,866] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-42 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,873] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-45 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,885] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-48 in 7 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:13,889] INFO [GroupMetadataManager brokerId=1001] Finished loading offsets and group metadata from __consumer_offsets-15 in 1 milliseconds. (kafka.coordinator.group.GroupMetadataManager)
kafka_1              | [2019-07-16 11:01:14,022] WARN [Producer clientId=producer-1] Error while fetching metadata with correlation id 1 : {__confluent.support.metrics=LEADER_NOT_AVAILABLE} (org.apache.kafka.clients.NetworkClient)
kafka_1              | [2019-07-16 11:01:14,034] INFO Cluster ID: n_GRoP1TRvayk2oit_iLsw (org.apache.kafka.clients.Metadata)
dataflow-server      | 2019-07-16 11:01:14.197  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode!
dataflow-server      | 2019-07-16 11:01:14.251  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data repositories in DEFAULT mode.
dataflow-server      | 2019-07-16 11:01:14.443  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 103ms. Found 0 repository interfaces.
kafka_1              | [2019-07-16 11:01:14,658] INFO [Producer clientId=producer-1] Closing the Kafka producer with timeoutMillis = 9223372036854775807 ms. (org.apache.kafka.clients.producer.KafkaProducer)
kafka_1              | [2019-07-16 11:01:14,670] INFO Successfully submitted metrics to Kafka topic __confluent.support.metrics (io.confluent.support.metrics.submitters.KafkaSubmitter)
dataflow-server      | 2019-07-16 11:01:15.386  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode!
dataflow-server      | 2019-07-16 11:01:15.401  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data repositories in DEFAULT mode.
dataflow-server      | 2019-07-16 11:01:16.964  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 1428ms. Found 1 repository interfaces.
service-discovery    | 2019-07-16 11:01:18.202  INFO 1 --- [           main] o.s.s.concurrent.ThreadPoolTaskExecutor  : Initializing ExecutorService 'applicationTaskExecutor'
dataflow-server      | 2019-07-16 11:01:18.780  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Multiple Spring Data modules found, entering strict repository configuration mode!
dataflow-server      | 2019-07-16 11:01:18.781  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Bootstrapping Spring Data repositories in DEFAULT mode.
kafka_1              | [2019-07-16 11:01:19,114] INFO Successfully submitted metrics to Confluent via secure endpoint (io.confluent.support.metrics.submitters.ConfluentSubmitter)
dataflow-server      | 2019-07-16 11:01:19.228  INFO 1 --- [           main] .s.d.r.c.RepositoryConfigurationDelegate : Finished Spring Data repository scanning in 446ms. Found 5 repository interfaces.
service-discovery    | 2019-07-16 11:01:21.070  INFO 1 --- [           main] o.s.s.c.ThreadPoolTaskScheduler          : Initializing ExecutorService 'taskScheduler'
service-discovery    | 2019-07-16 11:01:21.620  INFO 1 --- [           main] o.s.b.a.e.web.EndpointLinksResolver      : Exposing 3 endpoint(s) beneath base path '/actuator'
dataflow-server      | 2019-07-16 11:01:21.634  INFO 1 --- [           main] o.s.cloud.context.scope.GenericScope     : BeanFactory id=cc731ae1-1f20-3b1b-8b6b-7261cd82ddea
service-discovery    | 2019-07-16 11:01:22.136  INFO 1 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat started on port(s): 8181 (http) with context path ''
service-discovery    | 2019-07-16 11:01:22.202  INFO 1 --- [           main] lowPrometheusServiceDiscoveryApplication : Started DataflowPrometheusServiceDiscoveryApplication in 47.35 seconds (JVM running for 55.156)
skipper              | 2019-07-16 11:01:22.502  INFO 1 --- [           main] o.s.cloud.context.scope.GenericScope     : BeanFactory id=d00d927c-1f32-3d2e-bfe0-dd1ac6f1752d
dataflow-server      | 2019-07-16 11:01:24.905  INFO 1 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat initialized with port(s): 9393 (http)
dataflow-server      | 2019-07-16 11:01:24.978  INFO 1 --- [           main] o.a.coyote.http11.Http11NioProtocol      : Initializing ProtocolHandler ["http-nio-9393"]
dataflow-server      | 2019-07-16 11:01:25.043  INFO 1 --- [           main] o.apache.catalina.core.StandardService   : Starting service [Tomcat]
dataflow-server      | 2019-07-16 11:01:25.044  INFO 1 --- [           main] org.apache.catalina.core.StandardEngine  : Starting Servlet engine: [Apache Tomcat/9.0.16]
dataflow-server      | 2019-07-16 11:01:25.119  INFO 1 --- [           main] o.a.catalina.core.AprLifecycleListener   : The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
dataflow-server      | 2019-07-16 11:01:25.515  INFO 1 --- [           main] o.a.c.c.C.[Tomcat].[localhost].[/]       : Initializing Spring embedded WebApplicationContext
skipper              | 2019-07-16 11:01:25.916  INFO 1 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat initialized with port(s): 7577 (http)
skipper              | 2019-07-16 11:01:26.073  INFO 1 --- [           main] o.apache.catalina.core.StandardService   : Starting service [Tomcat]
skipper              | 2019-07-16 11:01:26.091  INFO 1 --- [           main] org.apache.catalina.core.StandardEngine  : Starting Servlet engine: [Apache Tomcat/9.0.16]
skipper              | 2019-07-16 11:01:26.173  INFO 1 --- [           main] o.a.catalina.core.AprLifecycleListener   : The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: [/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib]
skipper              | 2019-07-16 11:01:26.628  INFO 1 --- [           main] o.a.c.c.C.[Tomcat].[localhost].[/]       : Initializing Spring embedded WebApplicationContext
dataflow-server      | 2019-07-16 11:01:28.992  INFO 1 --- [           main] com.zaxxer.hikari.HikariDataSource       : HikariPool-1 - Starting...
dataflow-server      | 2019-07-16 11:01:29.592  INFO 1 --- [           main] com.zaxxer.hikari.HikariDataSource       : HikariPool-1 - Start completed.
dataflow-server      | 2019-07-16 11:01:29.962  INFO 1 --- [           main] o.f.c.internal.license.VersionPrinter    : Flyway Community Edition 5.2.4 by Boxfuse
dataflow-server      | 2019-07-16 11:01:30.040  INFO 1 --- [           main] o.f.c.internal.database.DatabaseFactory  : Database: jdbc:mysql://mysql:3306/dataflow (MySQL 5.7)
dataflow-server      | 2019-07-16 11:01:30.142  WARN 1 --- [           main] o.f.c.i.database.mysql.MySQLDatabase     : You are connected to a MySQL 5.7 database using the MariaDB driver. This is known to cause issues. An upgrade to Oracle's MySQL JDBC driver is highly recommended.
dataflow-server      | 2019-07-16 11:01:30.390  INFO 1 --- [           main] o.f.core.internal.command.DbValidate     : Successfully validated 1 migration (execution time 00:00.072s)
dataflow-server      | 2019-07-16 11:01:30.412  INFO 1 --- [           main] o.f.core.internal.command.DbMigrate      : Current version of schema `dataflow`: 1
dataflow-server      | 2019-07-16 11:01:30.414  INFO 1 --- [           main] o.f.core.internal.command.DbMigrate      : Schema `dataflow` is up to date. No migration necessary.
dataflow-server      | 2019-07-16 11:01:31.150  INFO 1 --- [           main] o.hibernate.jpa.internal.util.LogHelper  : HHH000204: Processing PersistenceUnitInfo [
dataflow-server      |  name: default
dataflow-server      |  ...]
dataflow-server      | 2019-07-16 11:01:31.488  INFO 1 --- [           main] org.hibernate.Version                    : HHH000412: Hibernate Core {5.3.7.Final}
dataflow-server      | 2019-07-16 11:01:31.501  INFO 1 --- [           main] org.hibernate.cfg.Environment            : HHH000206: hibernate.properties not found
skipper              | 2019-07-16 11:01:32.572  INFO 1 --- [           main] com.zaxxer.hikari.HikariDataSource       : HikariPool-1 - Starting...
dataflow-server      | 2019-07-16 11:01:32.722  INFO 1 --- [           main] o.hibernate.annotations.common.Version   : HCANN000001: Hibernate Commons Annotations {5.0.4.Final}
skipper              | 2019-07-16 11:01:33.013  INFO 1 --- [           main] com.zaxxer.hikari.HikariDataSource       : HikariPool-1 - Start completed.
skipper              | 2019-07-16 11:01:33.165  INFO 1 --- [           main] d.m.SkipperFlywayConfigurationCustomizer : Customizing flyway config, detected DatabaseDriver as MYSQL.
skipper              | 2019-07-16 11:01:33.306  INFO 1 --- [           main] o.f.c.internal.license.VersionPrinter    : Flyway Community Edition 5.2.4 by Boxfuse
skipper              | 2019-07-16 11:01:33.356  INFO 1 --- [           main] o.f.c.internal.database.DatabaseFactory  : Database: jdbc:mysql://mysql:3306/dataflow (MySQL 5.7)
skipper              | 2019-07-16 11:01:33.408  WARN 1 --- [           main] o.f.c.i.database.mysql.MySQLDatabase     : You are connected to a MySQL 5.7 database using the MariaDB driver. This is known to cause issues. An upgrade to Oracle's MySQL JDBC driver is highly recommended.
skipper              | 2019-07-16 11:01:33.528  WARN 1 --- [           main] o.f.c.i.database.mysql.MySQLDatabase     : You are connected to a MySQL 5.7 database using the MariaDB driver. This is known to cause issues. An upgrade to Oracle's MySQL JDBC driver is highly recommended.
skipper              | 2019-07-16 11:01:33.544  INFO 1 --- [           main] o.f.core.internal.command.DbValidate     : Successfully validated 1 migration (execution time 00:00.004s)
skipper              | 2019-07-16 11:01:33.597  INFO 1 --- [           main] o.f.core.internal.command.DbMigrate      : Current version of schema `dataflow`: 1
skipper              | 2019-07-16 11:01:33.598  INFO 1 --- [           main] o.f.core.internal.command.DbMigrate      : Schema `dataflow` is up to date. No migration necessary.
dataflow-server      | 2019-07-16 11:01:34.585  INFO 1 --- [           main] org.hibernate.dialect.Dialect            : HHH000400: Using dialect: org.hibernate.dialect.MySQL5Dialect
dataflow-server      | 2019-07-16 11:01:37.964  INFO 1 --- [           main] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default'
service-discovery    | 2019-07-16 11:01:40.644 ERROR 1 --- [   scheduling-1] o.s.c.d.p.s.LocalTargetsResolver         : ResourceAccessException: I/O error on GET request for "http://dataflow-server:9393/runtime/apps": Connection refused (Connection refused); nested exception is java.net.ConnectException: Connection refused (Connection refused)
service-discovery    | 2019-07-16 11:01:40.648  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local:
dataflow-server      | 2019-07-16 11:01:41.325  INFO 1 --- [           main] o.s.s.concurrent.ThreadPoolTaskExecutor  : Initializing ExecutorService 'applicationTaskExecutor'
dataflow-server      | 2019-07-16 11:01:41.553  WARN 1 --- [           main] aWebConfiguration$JpaWebMvcConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning
skipper              | 2019-07-16 11:01:41.903  INFO 1 --- [           main] j.LocalContainerEntityManagerFactoryBean : Initialized JPA EntityManagerFactory for persistence unit 'default'
dataflow-server      | 2019-07-16 11:01:44.704  INFO 1 --- [           main] o.s.b.c.r.s.JobRepositoryFactoryBean     : No database type set, using meta data indicating: MYSQL
dataflow-server      | 2019-07-16 11:01:44.887  INFO 1 --- [           main] o.s.c.d.s.b.SimpleJobServiceFactoryBean  : No database type set, using meta data indicating: MYSQL
dataflow-server      | 2019-07-16 11:01:46.492  INFO 1 --- [           main] .s.c.DataFlowControllerAutoConfiguration : Skipper URI [http://skipper-server:7577/api]
skipper              | 2019-07-16 11:01:46.488  INFO 1 --- [           main] o.s.s.concurrent.ThreadPoolTaskExecutor  : Initializing ExecutorService 'skipperStateMachineTaskExecutor'
dataflow-server      | 2019-07-16 11:01:47.456  INFO 1 --- [           main] o.a.coyote.http11.Http11NioProtocol      : Starting ProtocolHandler ["http-nio-9393"]
dataflow-server      | 2019-07-16 11:01:47.589  INFO 1 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat started on port(s): 9393 (http) with context path ''
dataflow-server      | 2019-07-16 11:01:47.617  INFO 1 --- [           main] o.s.c.d.s.s.DataFlowServerApplication    : Started DataFlowServerApplication in 72.597 seconds (JVM running for 82.367)
dataflow-server      | 2019-07-16 11:01:47.785  INFO 1 --- [           main] .s.c.d.s.s.LauncherInitializationService : Added 'Local' platform account 'default' into Task Launcher repository.
skipper              | 2019-07-16 11:01:48.124  INFO 1 --- [           main] o.s.c.s.s.s.ReleaseStateUpdateService    : Setting up ReleaseStateUpdateService
skipper              | 2019-07-16 11:01:48.222  INFO 1 --- [           main] o.s.s.concurrent.ThreadPoolTaskExecutor  : Initializing ExecutorService 'skipperThreadPoolTaskExecutor'
dataflow-server      | 2019-07-16 11:01:48.690  INFO 1 --- [nio-9393-exec-2] o.a.c.c.C.[Tomcat].[localhost].[/]       : Initializing Spring DispatcherServlet 'dispatcherServlet'
dataflow-server      | 2019-07-16 11:01:49.283 ERROR 1 --- [nio-9393-exec-2] o.s.c.d.s.c.RestControllerAdvice         : Caught exception while handling a request
dataflow-server      |
dataflow-server      | java.lang.RuntimeException: Error reading from URL [http://bit.ly/Einstein-SR2-stream-applications-kafka-maven]
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService.loadProperties(DefaultAppRegistryService.java:284)
dataflow-server      |  at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
dataflow-server      |  at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
dataflow-server      |  at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
dataflow-server      |  at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
dataflow-server      |  at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
dataflow-server      |  at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
dataflow-server      |  at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService.importAll(DefaultAppRegistryService.java:297)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService$$FastClassBySpringCGLIB$$a8bae4.invoke(<generated>)
dataflow-server      |  at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
dataflow-server      |  at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:749)
dataflow-server      |  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
dataflow-server      |  at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:294)
dataflow-server      |  at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98)
dataflow-server      |  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
dataflow-server      |  at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService$$EnhancerBySpringCGLIB$$9d3f25b2.importAll(<generated>)
dataflow-server      |  at org.springframework.cloud.dataflow.server.controller.AppRegistryController.registerAll(AppRegistryController.java:385)
dataflow-server      |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
dataflow-server      |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
dataflow-server      |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
dataflow-server      |  at java.lang.reflect.Method.invoke(Method.java:498)
dataflow-server      |  at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:189)
dataflow-server      |  at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:102)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:800)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
dataflow-server      |  at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1038)
dataflow-server      |  at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:942)
dataflow-server      |  at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1005)
dataflow-server      |  at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:908)
dataflow-server      |  at javax.servlet.http.HttpServlet.service(HttpServlet.java:660)
dataflow-server      |  at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:882)
dataflow-server      |  at javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:101)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.boot.actuate.web.trace.servlet.HttpTraceFilter.doFilterInternal(HttpTraceFilter.java:90)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:117)
dataflow-server      |  at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:106)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:200)
dataflow-server      |  at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
dataflow-server      |  at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
dataflow-server      |  at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
dataflow-server      |  at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
dataflow-server      |  at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
dataflow-server      |  at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
dataflow-server      |  at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
dataflow-server      |  at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
dataflow-server      |  at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:834)
dataflow-server      |  at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
dataflow-server      |  at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
dataflow-server      |  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
dataflow-server      |  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
dataflow-server      |  at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
dataflow-server      |  at java.lang.Thread.run(Thread.java:748)
dataflow-server      | Caused by: java.net.SocketException: Unexpected end of file from server
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:851)
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:848)
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
dataflow-server      |  at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1587)
dataflow-server      |  at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492)
dataflow-server      |  at org.springframework.core.io.UrlResource.getInputStream(UrlResource.java:173)
dataflow-server      |  at org.springframework.core.io.support.PropertiesLoaderUtils.fillProperties(PropertiesLoaderUtils.java:133)
dataflow-server      |  at org.springframework.core.io.support.PropertiesLoaderUtils.loadProperties(PropertiesLoaderUtils.java:122)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService.loadProperties(DefaultAppRegistryService.java:281)
dataflow-server      |  ... 84 common frames omitted
dataflow-server      |
skipper              | 2019-07-16 11:01:49.431  INFO 1 --- [           main] o.s.s.concurrent.ThreadPoolTaskExecutor  : Initializing ExecutorService 'applicationTaskExecutor'
app-import_1         | Stream apps imported
skipper              | 2019-07-16 11:01:49.695  WARN 1 --- [           main] aWebConfiguration$JpaWebMvcConfiguration : spring.jpa.open-in-view is enabled by default. Therefore, database queries may be performed during view rendering. Explicitly configure spring.jpa.open-in-view to disable this warning
dataflow-server      | 2019-07-16 11:01:49.760 ERROR 1 --- [nio-9393-exec-3] o.s.c.d.s.c.RestControllerAdvice         : Caught exception while handling a request
dataflow-server      |
dataflow-server      | java.lang.RuntimeException: Error reading from URL [http://bit.ly/Dearborn-SR1-task-applications-maven]
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService.loadProperties(DefaultAppRegistryService.java:284)
dataflow-server      |  at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
dataflow-server      |  at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
dataflow-server      |  at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
dataflow-server      |  at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
dataflow-server      |  at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
dataflow-server      |  at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
dataflow-server      |  at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:499)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService.importAll(DefaultAppRegistryService.java:297)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService$$FastClassBySpringCGLIB$$a8bae4.invoke(<generated>)
dataflow-server      |  at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
dataflow-server      |  at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:749)
dataflow-server      |  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
dataflow-server      |  at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:294)
dataflow-server      |  at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:98)
dataflow-server      |  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
dataflow-server      |  at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService$$EnhancerBySpringCGLIB$$9d3f25b2.importAll(<generated>)
dataflow-server      |  at org.springframework.cloud.dataflow.server.controller.AppRegistryController.registerAll(AppRegistryController.java:385)
dataflow-server      |  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
dataflow-server      |  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
dataflow-server      |  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
dataflow-server      |  at java.lang.reflect.Method.invoke(Method.java:498)
dataflow-server      |  at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:189)
dataflow-server      |  at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:102)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:800)
dataflow-server      |  at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
dataflow-server      |  at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1038)
dataflow-server      |  at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:942)
dataflow-server      |  at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1005)
dataflow-server      |  at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:908)
dataflow-server      |  at javax.servlet.http.HttpServlet.service(HttpServlet.java:660)
dataflow-server      |  at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:882)
dataflow-server      |  at javax.servlet.http.HttpServlet.service(HttpServlet.java:741)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:101)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.boot.actuate.web.trace.servlet.HttpTraceFilter.doFilterInternal(HttpTraceFilter.java:90)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.FormContentFilter.doFilterInternal(FormContentFilter.java:92)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.HiddenHttpMethodFilter.doFilterInternal(HiddenHttpMethodFilter.java:93)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.filterAndRecordMetrics(WebMvcMetricsFilter.java:117)
dataflow-server      |  at org.springframework.boot.actuate.metrics.web.servlet.WebMvcMetricsFilter.doFilterInternal(WebMvcMetricsFilter.java:106)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
dataflow-server      |  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
dataflow-server      |  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
dataflow-server      |  at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:200)
dataflow-server      |  at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
dataflow-server      |  at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
dataflow-server      |  at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
dataflow-server      |  at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
dataflow-server      |  at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
dataflow-server      |  at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
dataflow-server      |  at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
dataflow-server      |  at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
dataflow-server      |  at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:834)
dataflow-server      |  at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1415)
dataflow-server      |  at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
dataflow-server      |  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
dataflow-server      |  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
dataflow-server      |  at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
dataflow-server      |  at java.lang.Thread.run(Thread.java:748)
dataflow-server      | Caused by: java.net.SocketException: Unexpected end of file from server
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:851)
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:848)
dataflow-server      |  at sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:678)
dataflow-server      |  at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1587)
dataflow-server      |  at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1492)
dataflow-server      |  at org.springframework.core.io.UrlResource.getInputStream(UrlResource.java:173)
dataflow-server      |  at org.springframework.core.io.support.PropertiesLoaderUtils.fillProperties(PropertiesLoaderUtils.java:133)
dataflow-server      |  at org.springframework.core.io.support.PropertiesLoaderUtils.loadProperties(PropertiesLoaderUtils.java:122)
dataflow-server      |  at org.springframework.cloud.dataflow.registry.service.DefaultAppRegistryService.loadProperties(DefaultAppRegistryService.java:281)
dataflow-server      |  ... 84 common frames omitted
dataflow-server      |
app-import_1         | Task apps imported
spring-cloud-dataflow_app-import_1 exited with code 0
skipper              | 2019-07-16 11:01:52.735  INFO 1 --- [           main] o.s.b.w.embedded.tomcat.TomcatWebServer  : Tomcat started on port(s): 7577 (http) with context path ''
skipper              | 2019-07-16 11:01:52.743  INFO 1 --- [           main] o.s.c.s.s.app.SkipperServerApplication   : Started SkipperServerApplication in 72.052 seconds (JVM running for 78.823)
skipper              | 2019-07-16 11:01:53.113  WARN 1 --- [           main] .c.s.s.s.RepositoryInitializationService : Ignoring application repository configuration for local because name org.springframework.cloud.skipper.server.config.SkipperServerProperties$PackageRepository already exists.
skipper              | 2019-07-16 11:01:53.386  INFO 1 --- [           main] .s.c.s.s.s.DeployerInitializationService : Added 'Local' platform account 'default' into deployer repository.
skipper              | 2019-07-16 11:01:55.858  INFO 1 --- [nio-7577-exec-1] o.a.c.c.C.[Tomcat].[localhost].[/]       : Initializing Spring DispatcherServlet 'dispatcherServlet'
dataflow-server      | 2019-07-16 11:02:00.120  INFO 1 --- [nio-9393-exec-5] o.h.h.i.QueryTranslatorFactoryInitiator  : HHH000397: Using ASTQueryTranslatorFactory
service-discovery    | 2019-07-16 11:02:00.972  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":[],"labels":{"job":"scdf"}}]
prometheus           | level=error ts=2019-07-16T11:02:00.983351716Z caller=file.go:321 component="discovery manager scrape" discovery=file msg="Error reading file" path=/etc/prometheus/targets.json err="unexpected end of JSON input"
</generated></generated></generated></generated>

该提问来源于开源项目:spring-cloud/spring-cloud-dataflow

  • 点赞
  • 写回答
  • 关注问题
  • 收藏
  • 复制链接分享
  • 邀请回答

5条回答

  • weixin_39526459 weixin_39526459 5月前

    Thanks. What you shared ^^ is what I tried, except the apps' version, but that shouldn't in any capacity interfere to cause the deployment issues. Also, I think unexpected end of JSON input is just noise, and you can ignore it. Once when the stream deploys, you will not see that error anymore - I guess that the initial discovery is failing because there are no "running" apps to scrape metrics from it.

    All that said, given your current observations, all the signs point to not having enough memory capacity allocated to the Docker daemon from where you're running SCDF/Skipper, and of course, where you're deploying apps to. Please review the troubleshooting guide for the symptoms and the possible causes.

    tl;dr: If you are going to use the docker-compose YAML that we ship without any customizations, you'd need a minimum of 8G memory allocated to the Docker daemon. The Docker Compose experience starts a whole set of applications and middleware dependencies [see: here]. Alos, the more the number of apps that you deploy as part of the streaming data pipelines, each of the apps directly also participate in the total memory, so you'd need to size the resources based on your requirements.

    Why?

    As streams are deployed via Skipper, applications that are part of that stream will be launched as Java processes on the Skipper container. For every part of a stream, an application is deployed. The overall resource allocation (memory, CPU, etc) provided to Docker should account for the number of deployed applications.

    As an FYI, here's the screenshot of my Docker of Desktop preferences:

    image

    点赞 评论 复制链接分享
  • weixin_39610956 weixin_39610956 5月前

    you are my hero !

    My Mac only 8G RAM. I previously only allocated 2G of memory to Docker. After allocation 4G memory, barely up and running.

    Cheers! 🍺

    点赞 评论 复制链接分享
  • weixin_39526459 weixin_39526459 5月前

    Glad you are up and running. Thank you for your interest in Spring Cloud Data Flow!

    点赞 评论 复制链接分享
  • weixin_39526459 weixin_39526459 5月前

    Hi, . I attempted to retry the same exact commands locally, and everything appears to come up just fine. I do see the same error in the logs, though. However, when the stream is deployed, Prometheus is able to successfully scrape the logs using the service-discovery component, and the Grafana Dashboard comes up just fine as well.

    Dashboard: image

    Logs:

    
    service-discovery    | 2019-07-16 14:18:20.053  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":["skipper-server:20001","skipper-server:20052"],"labels":{"job":"scdf"}}]
    grafana              | t=2019-07-16T14:18:31+0000 lvl=info msg="Request Completed" logger=context userId=0 orgId=0 uname= method=GET path=/d/scdf-applications/applications status=302 remote_addr=172.20.0.1 time_ms=6 size=29 referer=http://localhost:9393/dashboard/
    service-discovery    | 2019-07-16 14:18:40.164  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":["skipper-server:20001","skipper-server:20052"],"labels":{"job":"scdf"}}]
    service-discovery    | 2019-07-16 14:19:02.100  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":["skipper-server:20001","skipper-server:20052"],"labels":{"job":"scdf"}}]
    service-discovery    | 2019-07-16 14:19:20.106  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":["skipper-server:20001","skipper-server:20052"],"labels":{"job":"scdf"}}]
    

    Are you not seeing the same behavior? If you could describe what anomalies you see, we can further review.

    点赞 评论 复制链接分享
  • weixin_39610956 weixin_39610956 5月前

    Hi, . Unlike you, my deployment stream always fails. The following are the detailed steps

    1. Add Application: Bulk import application from url https://dataflow.spring.io/Einstein-SR3-stream-applications-rabbit-maven (this link from cloud.spring.io)
    2. Create Steam: input demo = time | log, click Create Steam

    Status always shows in deploying... After a while(may be 5 minutes.), the display PARTIAL to be deployed

    Log:

    
    service-discovery    | 2019-07-17 05:30:00.089  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":[],"labels":{"job":"scdf"}}]
    dataflow-server      | 2019-07-17 05:30:03.395  WARN 1 --- [nio-9393-exec-2] o.s.c.d.s.c.RestControllerAdvice         : Caught exception while handling a request: Could not find stream definition named demo
    dataflow-server      | 2019-07-17 05:30:03.415  WARN 1 --- [nio-9393-exec-1] o.s.c.d.s.c.RestControllerAdvice         : Caught exception while handling a request: Could not find stream definition named demo
    dataflow-server      | 2019-07-17 05:30:03.442  WARN 1 --- [nio-9393-exec-4] o.s.c.d.s.c.RestControllerAdvice         : Caught exception while handling a request: Could not find stream definition named demo
    service-discovery    | 2019-07-17 05:30:20.106  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":[],"labels":{"job":"scdf"}}]
    prometheus           | level=error ts=2019-07-17T05:30:20.114245305Z caller=file.go:321 component="discovery manager scrape" discovery=file msg="Error reading file" path=/etc/prometheus/targets.json err="unexpected end of JSON input"
    service-discovery    | 2019-07-17 05:30:40.102  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":[],"labels":{"job":"scdf"}}]
    service-discovery    | 2019-07-17 05:31:00.066  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":[],"labels":{"job":"scdf"}}]
    service-discovery    | 2019-07-17 05:31:20.040  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":[],"labels":{"job":"scdf"}}]
    prometheus           | level=error ts=2019-07-17T05:31:20.042131371Z caller=file.go:321 component="discovery manager scrape" discovery=file msg="Error reading file" path=/etc/prometheus/targets.json err="unexpected end of JSON input"
    dataflow-server      | 2019-07-17 05:31:24.409  INFO 1 --- [nio-9393-exec-1] .s.c.d.s.s.i.AppDeploymentRequestCreator : Creating resource with [maven://org.springframework.cloud.stream.app:log-sink-rabbit:2.1.1.RELEASE] for application [log]
    dataflow-server      | 2019-07-17 05:31:24.655  INFO 1 --- [nio-9393-exec-1] .s.c.d.s.s.i.AppDeploymentRequestCreator : Creating resource with [maven://org.springframework.cloud.stream.app:time-source-rabbit:2.1.0.RELEASE] for application [time]
    dataflow-server      | 2019-07-17 05:31:24.781  INFO 1 --- [nio-9393-exec-1] o.s.c.d.s.stream.SkipperStreamDeployer   : Deploying Stream demo using skipper.
    dataflow-server      | 2019-07-17 05:31:24.823  INFO 1 --- [nio-9393-exec-1] o.s.c.d.s.stream.SkipperStreamDeployer   : Using platform 'default'
    skipper              | 2019-07-17 05:31:25.438  INFO 1 --- [nio-7577-exec-7] o.s.s.s.DefaultStateMachineService       : Acquiring machine with id demo
    skipper              | 2019-07-17 05:31:25.441  INFO 1 --- [nio-7577-exec-7] o.s.s.s.DefaultStateMachineService       : Getting new machine from factory with id demo
    skipper              | 2019-07-17 05:31:25.614  INFO 1 --- [nio-7577-exec-7] o.s.s.support.LifecycleObjectSupport     : started org.springframework.statemachine.trigger.TimerTrigger
    skipper              | 2019-07-17 05:31:25.617  INFO 1 --- [nio-7577-exec-7] o.s.s.support.LifecycleObjectSupport     : started org.springframework.statemachine.support.DefaultStateMachineExecutor
    skipper              | 2019-07-17 05:31:25.618  INFO 1 --- [nio-7577-exec-7] o.s.s.support.LifecycleObjectSupport     : started ROLLBACK ROLLBACK_START ROLLBACK_EXIT_INSTALL ROLLBACK_EXIT_UPGRADE ROLLBACK_CHOICE ROLLBACK_EXIT UPGRADE UPGRADE_DEPLOY_TARGET_APPS_SUCCEED UPGRADE_DEPLOY_TARGET_APPS UPGRADE_START UPGRADE_DELETE_SOURCE_APPS UPGRADE_WAIT_TARGET_APPS UPGRADE_CANCEL UPGRADE_CHECK_TARGET_APPS UPGRADE_DEPLOY_TARGET_APPS_FAILED UPGRADE_EXIT UPGRADE_CHECK_CHOICE ERROR INSTALL INSTALL_INSTALL INSTALL_EXIT DELETE DELETE_DELETE DELETE_EXIT INITIAL ERROR_JUNCTION  /  / uuid=2db485b1-5438-48d4-be8f-cf7ef0193f7b / id=demo
    skipper              | 2019-07-17 05:31:25.834  INFO 1 --- [eTaskExecutor-1] o.s.c.s.s.s.StateMachineConfiguration    : Entering state ObjectState [getIds()=[INITIAL], getClass()=class org.springframework.statemachine.state.ObjectState, hashCode()=1691560424, toString()=AbstractState [id=INITIAL, pseudoState=org.springframework.statemachine.state.DefaultPseudoState, deferred=[], entryActions=[], exitActions=[org.springframework.cloud.skipper.server.statemachine.ResetVariablesAction], stateActions=[], regions=[], submachine=null]]
    skipper              | 2019-07-17 05:31:25.881  INFO 1 --- [eTaskExecutor-3] o.s.c.s.s.s.StateMachineConfiguration    : Entering state StateMachineState [getIds()=[INSTALL], toString()=AbstractState [id=INSTALL, pseudoState=null, deferred=[], entryActions=[], exitActions=[], stateActions=[], regions=[], submachine=INSTALL_INSTALL INSTALL_EXIT  /  / uuid=401992fe-8d39-47ec-be38-9fc1ad7cdbae / id=demo], getClass()=class org.springframework.statemachine.state.StateMachineState]
    skipper              | 2019-07-17 05:31:25.927  INFO 1 --- [eTaskExecutor-3] o.s.c.s.s.s.StateMachineConfiguration    : Entering state ObjectState [getIds()=[INSTALL_INSTALL], getClass()=class org.springframework.statemachine.state.ObjectState, hashCode()=735772508, toString()=AbstractState [id=INSTALL_INSTALL, pseudoState=org.springframework.statemachine.state.DefaultPseudoState, deferred=[], entryActions=[org.springframework.cloud.skipper.server.statemachine.InstallInstallAction], exitActions=[], stateActions=[], regions=[], submachine=null]]
    skipper              | 2019-07-17 05:31:26.824  INFO 1 --- [eTaskExecutor-3] o.s.c.d.spi.local.LocalAppDeployer       : Preparing to run an application from org.springframework.cloud.stream.app:time-source-rabbit:jar:2.1.0.RELEASE. This may take some time if the artifact must be downloaded from a remote host.
    skipper              | 2019-07-17 05:31:26.880  INFO 1 --- [eTaskExecutor-3] o.s.c.d.spi.local.LocalAppDeployer       : Command to be executed: /opt/openjdk/bin/java -jar /root/.m2/repository/org/springframework/cloud/stream/app/time-source-rabbit/2.1.0.RELEASE/time-source-rabbit-2.1.0.RELEASE.jar
    skipper              | 2019-07-17 05:31:26.907  INFO 1 --- [eTaskExecutor-3] o.s.c.d.spi.local.LocalAppDeployer       : Deploying app with deploymentId demo.time-v1 instance 0.
    skipper              |    Logs will be in /tmp/spring-cloud-deployer-1866139457792568651/demo-1563341486700/demo.time-v1
    skipper              | 2019-07-17 05:31:27.018  INFO 1 --- [eTaskExecutor-3] o.s.c.d.spi.local.LocalAppDeployer       : Preparing to run an application from org.springframework.cloud.stream.app:log-sink-rabbit:jar:2.1.1.RELEASE. This may take some time if the artifact must be downloaded from a remote host.
    skipper              | 2019-07-17 05:31:27.021  INFO 1 --- [eTaskExecutor-3] o.s.c.d.spi.local.LocalAppDeployer       : Command to be executed: /opt/openjdk/bin/java -jar /root/.m2/repository/org/springframework/cloud/stream/app/log-sink-rabbit/2.1.1.RELEASE/log-sink-rabbit-2.1.1.RELEASE.jar
    skipper              | 2019-07-17 05:31:27.032  INFO 1 --- [eTaskExecutor-3] o.s.c.d.spi.local.LocalAppDeployer       : Deploying app with deploymentId demo.log-v1 instance 0.
    skipper              |    Logs will be in /tmp/spring-cloud-deployer-1866139457792568651/demo-1563341486916/demo.log-v1
    skipper              | 2019-07-17 05:31:27.276  INFO 1 --- [eTaskExecutor-3] o.s.s.support.LifecycleObjectSupport     : stopped org.springframework.statemachine.support.DefaultStateMachineExecutor
    skipper              | 2019-07-17 05:31:27.279  INFO 1 --- [eTaskExecutor-3] o.s.s.support.LifecycleObjectSupport     : stopped INSTALL_INSTALL INSTALL_EXIT  /  / uuid=401992fe-8d39-47ec-be38-9fc1ad7cdbae / id=demo
    skipper              | 2019-07-17 05:31:27.283  INFO 1 --- [eTaskExecutor-3] o.s.c.s.s.s.StateMachineConfiguration    : Entering state ObjectState [getIds()=[INITIAL], getClass()=class org.springframework.statemachine.state.ObjectState, hashCode()=1691560424, toString()=AbstractState [id=INITIAL, pseudoState=org.springframework.statemachine.state.DefaultPseudoState, deferred=[], entryActions=[], exitActions=[org.springframework.cloud.skipper.server.statemachine.ResetVariablesAction], stateActions=[], regions=[], submachine=null]]
    skipper              | 2019-07-17 05:31:27.284  INFO 1 --- [eTaskExecutor-3] o.s.c.s.s.s.SkipperStateMachineService   : setting future value org.springframework.cloud.skipper.domain.Release
    skipper              | 2019-07-17 05:31:27.286  INFO 1 --- [eTaskExecutor-3] o.s.s.support.LifecycleObjectSupport     : started org.springframework.statemachine.support.DefaultStateMachineExecutor
    skipper              | 2019-07-17 05:31:27.289  INFO 1 --- [eTaskExecutor-3] o.s.s.support.LifecycleObjectSupport     : started INSTALL_INSTALL INSTALL_EXIT  /  / uuid=401992fe-8d39-47ec-be38-9fc1ad7cdbae / id=demo
    service-discovery    | 2019-07-17 05:31:40.676  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":["skipper-server:20009","skipper-server:20018"],"labels":{"job":"scdf"}}]
    service-discovery    | 2019-07-17 05:32:01.330  INFO 1 --- [   scheduling-1] lowPrometheusServiceDiscoveryApplication : local: [{"targets":["skipper-server:20009","skipper-server:20018"],"labels":{"job":"scdf"}}]
    kafka_1              | [2019-07-17 05:32:21,156] WARN Client session timed out, have not heard from server in 4212ms for sessionid 0x100000150510001 (org.apache.zookeeper.ClientCnxn)
    zookeeper_1          | [2019-07-17 05:32:31,112] INFO Expiring session 0x100000150510001, timeout of 6000ms exceeded (org.apache.zookeeper.server.ZooKeeperServer)
    kafka_1              | [2019-07-17 05:32:34,101] INFO Client session timed out, have not heard from server in 4212ms for sessionid 0x100000150510001, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
    zookeeper_1          | [2019-07-17 05:32:34,161] INFO Processed session termination for sessionid: 0x100000150510001 (org.apache.zookeeper.server.PrepRequestProcessor)
    zookeeper_1          | [2019-07-17 05:32:57,299] INFO Closed socket connection for client /172.18.0.6:54880 which had sessionid 0x100000150510001 (org.apache.zookeeper.server.NIOServerCnxn)
    kafka_1              | [2019-07-17 05:33:01,140] TRACE [Controller id=1001] Checking need to trigger auto leader balancing (kafka.controller.KafkaController)
    
    点赞 评论 复制链接分享

相关推荐