title | description | keywords | services | documentationcenter | author | manager | editor | ms.service | ms.workload | ms.tgt_pltfrm | ms.devlang | ms.topic | ms.date | ms.author |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Why does Tez application hang? | Microsoft Docs |
Use the Hive FAQ for answers to common questions on Hive on Azure HDInsight platform. |
Azure HDInsight, ambari, Tez, FAQ, troubleshooting guide, |
Azure HDInsight |
na |
multiple |
na |
na |
na |
article |
09/24/2018 |
shzhao |
After submitting hive job, in Tez view, I see lots of Tez job in "Running" status but doesn't make any progress.
- A common problem is that user submitted too many jobs that get queued in the Yarn queue, we need to rule that out first. Go to the Yarn UI (https://.azurehdinsight.net/yarnui), and look at "Cluster Metrics" at the top of the UI. Especially the "Apps Pending" field: if this number is big (dozens to hundreds), it indicates that the user has submitted too many Yarn applications (one example is that user use Templeton to submit lots of Hive jobs).
- If the root cause is the long Yarn queue. We can scale up the cluster to cope with the situation, or just wait till the Yarn queue is drained. Note that by default "yarn.scheduler.capacity.maximum-applications" controls the maximum number of applications that are running or pending, and it defaults to 10000.