Article - CS290196

Dataset jobs remains in running when using an incomplete metadata json file in ThingWorx Analytics Server 8.3

Modified: 04-Dec-2018   


Applies To

  • ThingWorx Analytics 8.3 F000

Description

  • Dataset jobs remains in running when using an incomplete metadata json file
  • ThingWorx Analytics Builder Upload UI deos not return
  • Pressing Cancel does not show the job in the UI
  • However Executing DataThing.getJobStatuses() service show the job in RUNNING state
  • worker process does use resources (cpu/RAM)
  • Following error can be seen in worker.log
The job com.thingworx.analytics.data.service.CreateDataSetJob@4365f92e of type CreateDataSetJob seems to have failed.
java.lang.NullPointerException: null
    at com.thingworx.analytics.ccc.data.ref.DatasetRefMetadata.toField(DatasetRefMetadata.java:85)
    at com.thingworx.analytics.ccc.data.datasources.FileSchemaSource.lambda$load$0(FileSchemaSource.java:37)
    at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193)
    at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1374)
    at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481)
    at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
    at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:545)
    at java.util.stream.AbstractPipeline.evaluateToArrayNode(AbstractPipeline.java:260)
    at java.util.stream.ReferencePipeline.toArray(ReferencePipeline.java:438)
    at com.thingworx.analytics.ccc.data.datasources.FileSchemaSource.load(FileSchemaSource.java:37)
    at com.thingworx.analytics.ccc.data.datasources.DatasetFactory$SchemaSource.loadDontApplyExclusions(DatasetFactory.java:85)
    at com.thingworx.analytics.ccc.data.datasources.DatasetFactory.lambda$getSchemaSource$4(DatasetFactory.java:182)
    at com.thingworx.analytics.ccc.data.datasources.CsvDatasetSource.createExpectedSchema(CsvDatasetSource.java:90)
    at com.thingworx.analytics.ccc.data.datasources.CsvDatasetSource.convertToCsvSchema(CsvDatasetSource.java:83)
    at com.thingworx.analytics.ccc.data.datasources.CsvFileSparkDatasetSource.load(CsvFileSparkDatasetSource.java:41)
    at com.thingworx.analytics.ccc.data.datasources.CsvDatasetSource.load(CsvDatasetSource.java:49)
    at com.thingworx.analytics.ccc.data.datasources.DatasetFactory.createDataset(DatasetFactory.java:103)
    at com.thingworx.analytics.ccc.data.datasources.DatasetFactory.create(DatasetFactory.java:118)
    at com.thingworx.analytics.data.runner.DatasetLoader.accept(DatasetLoader.java:30)
    at com.thingworx.analytics.data.runner.CreateDataSetRunner.run(CreateDataSetRunner.java:54)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at com.thingworx.analytics.data.service.AbstractDataServiceJob.run(AbstractDataServiceJob.java:64)
    at com.thingworx.analytics.ccc.job.dempsy.DempsyClusterJobExecutor$DempsyPersistentClusterWatcher.runJobUploadResultsAndCleanup(DempsyClusterJobExecutor.java:417)
    at com.thingworx.analytics.ccc.job.dempsy.DempsyClusterJobExecutor$DempsyPersistentClusterWatcher.execute(DempsyClusterJobExecutor.java:581)
    at com.thingworx.analytics.ccc.executor.PersistentTask.executeUntilWorks(PersistentTask.java:94)
    at com.thingworx.analytics.ccc.executor.PersistentTask.process(PersistentTask.java:60)
    at net.dempsy.cluster.zookeeper.ZookeeperSession$WatcherProxy.process(ZookeeperSession.java:232)
    at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
    at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
  •  
This is a printer-friendly version of Article 290196 and may be out of date. For the latest version click CS290196