Article - CS320643

Some transformed properties do not work. flink log file report "java.net.SocketException: Too many open files" in Platform Analytics

Modified: 11-Feb-2020   


Applies To

  • ThingWorx Analytics 8.4

Description

  • Some transformed properties have an unhealthy status
  • taskmanager and jobmanager flink log files report

java.io.IOException: Failed to fetch BLOB XXXX from YYYY:ZZZZ and store it under /tmp/blobStore-XXXX/incoming/temp-00003909
    at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:191)
    at org.apache.flink.runtime.blob.AbstractBlobCache.getFileInternal(AbstractBlobCache.java:177)
    at org.apache.flink.runtime.blob.PermanentBlobCache.getFile(PermanentBlobCache.java:205)
    at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager.registerTask(BlobLibraryCacheManager.java:119)
    at org.apache.flink.runtime.taskmanager.Task.createUserCodeClassloader(Task.java:878)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:589)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Could not connect to BlobServer at address /YYYY:ZZZZ
    at org.apache.flink.runtime.blob.BlobClient.<init>(BlobClient.java:124)
    at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:165)
    ... 6 more
Caused by: java.net.SocketException: Too many open files
    at java.net.Socket.createImpl(Socket.java:460)
    at java.net.Socket.connect(Socket.java:587)
    at java.net.Socket.connect(Socket.java:538)
    at org.apache.flink.runtime.blob.BlobClient.<init>(BlobClient.java:118)
    ... 7 more


java.io.IOException: Could not connect to BlobServer at address /YYYY:ZZZZ
    at org.apache.flink.runtime.blob.BlobClient.<init>(BlobClient.java:124)
    at org.apache.flink.runtime.blob.BlobClient.downloadFromBlobServer(BlobClient.java:165)
    at org.apache.flink.runtime.blob.AbstractBlobCache.getFileInternal(AbstractBlobCache.java:177)
    at org.apache.flink.runtime.blob.PermanentBlobCache.getFile(PermanentBlobCache.java:205)
    at org.apache.flink.runtime.execution.librarycache.BlobLibraryCacheManager.registerTask(BlobLibraryCacheManager.java:119)
    at org.apache.flink.runtime.taskmanager.Task.createUserCodeClassloader(Task.java:878)
    at org.apache.flink.runtime.taskmanager.Task.run(Task.java:589)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketException: Too many open files
    at java.net.Socket.createImpl(Socket.java:460)
    at java.net.Socket.connect(Socket.java:587)
    at java.net.Socket.connect(Socket.java:538)
    at org.apache.flink.runtime.blob.BlobClient.<init>(BlobClient.java:118)
    ... 7 more

Failed to list contents of /tmp/blobStore-XXXX
    at org.apache.flink.util.FileUtils.cleanDirectory(FileUtils.java:212)
    at org.apache.flink.util.FileUtils.deleteDirectory(FileUtils.java:146)
    at org.apache.flink.runtime.blob.PermanentBlobCache$PermanentBlobCleanupTask.run(PermanentBlobCache.java:271)
    at java.util.TimerThread.mainLoop(Timer.java:555)
    at java.util.TimerThread.run(Timer.java:505)
This is a printer-friendly version of Article 320643 and may be out of date. For the latest version click CS320643