使用prometheus测试spark操作符,但导出器端口8090未打开

bvn4nwqk  于 2021-05-18  发布在  Spark
关注(0)|答案(0)|浏览(252)

我正在使用spark-pi-prometheus.yaml运行示例:https://github.com/googlecloudplatform/spark-on-k8s-operator/blob/master/examples/spark-pi-prometheus.yaml

apiVersion: "sparkoperator.k8s.io/v1beta2"
kind: SparkApplication
metadata:
  name: spark-pi
  namespace: default
spec:
  type: Scala
  mode: cluster
  image: "gcr.io/spark-operator/spark:v3.0.0-gcs-prometheus"
  imagePullPolicy: IfNotPresent
  mainClass: org.apache.spark.examples.SparkPi
  mainApplicationFile: "local:///opt/spark/examples/jars/spark-examples_2.12-3.0.0.jar"
  arguments:
    - "100000"
  sparkVersion: "3.0.0"
  restartPolicy:
    type: Never
  driver:
    cores: 1
    coreLimit: "1200m"
    memory: "512m"
    labels:
      version: 3.0.0
    serviceAccount: spark
  executor:
    cores: 1
    instances: 1
    memory: "512m"
    labels:
      version: 3.0.0
  monitoring:
    exposeDriverMetrics: true
    exposeExecutorMetrics: true
    prometheus:
      jmxExporterJar: "/prometheus/jmx_prometheus_javaagent-0.11.0.jar"
      port: 8090

应用程序启动了,但是jmxexporter端口8090没有打开。有人能帮忙吗?谢谢!

[root@master examples]# sparkctl list
+----------+-----------+----------------+-----------------+
|   NAME   |   STATE   | SUBMISSION AGE | TERMINATION AGE |
+----------+-----------+----------------+-----------------+
| spark-pi | RUNNING   | 10h            | N.A.            |
| +----------+-----------+----------------+-----------------+

[root@master examples]# kubectl get endpoints
NAME                                   ENDPOINTS                                            AGE
kubernetes                             192.168.96.131:6443                                  86d
spark-pi-557987757045c556-driver-svc   10.244.1.41:4040,10.244.1.41:7078,10.244.1.41:7079   28s
spark-pi-ui-svc                        10.244.1.41:4040                                     28s

[root@master examples]# netstat -an|grep 8090
[root@master examples]#

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题