Skip to content

Query Engine (Trino)#

As a Hopsworks administrator, you can monitor and manage the Trino cluster used for query execution across all projects. The admin interface provides cluster-wide visibility into resources, performance, and worker health.

Cluster Overview#

The cluster overview provides a comprehensive view of your Trino deployment, including:

  • Cluster status: Overall health and availability
  • Active queries: Total number of running queries across all projects
  • Worker nodes: Number of active and total workers
  • Resource utilization: Cluster-wide CPU and memory usage
  • Query throughput: Average query execution times and data processed

Use this dashboard to monitor overall cluster health and identify capacity issues.

cluster overview
Trino cluster overview

Query History#

The query history shows all queries executed across the Trino cluster, regardless of project. This centralized view helps administrators:

  • Monitor usage patterns: Identify peak usage times and resource-intensive queries
  • Troubleshoot issues: Investigate failed or slow queries
  • Audit activity: Track query execution by project and user
  • Optimize performance: Identify queries that may need optimization

Each query entry displays:

  • Query ID and text
  • Project and user who executed it
  • Status (running, completed, failed)
  • Execution time and resources consumed
  • Timestamp

Click any query to view detailed execution information.

query history
Trino query history

Managing Workers#

The workers view displays all Trino nodes in the cluster. For each node, you can see:

  • Node IP: IP address of the worker node
  • Node version: Trino version running on the node
  • Coordinator or worker: Role of the node (coordinator or worker)
  • State: Current state of the node (active, idle, or offline)

This view helps you monitor the cluster topology and identify any nodes that may be offline or experiencing issues.

workers
Trino workers

Worker Status Details#

Click on a worker to view detailed status information:

  • Resource metrics: Detailed CPU, memory, and network usage over time
  • Task breakdown: Types and number of tasks being executed
  • Error logs: Any errors or warnings from the worker
  • Configuration: Worker settings and assigned resources
  • Performance history: Historical performance trends

Use this detailed view to diagnose worker-specific issues and optimize resource allocation.

worker status
Trino worker status

Configuration#

Trino behavior can be customized through cluster configuration variables. To modify these settings, navigate to Cluster Settings → Configuration and search for the variable name.

Available Variables:

  • trino_enabled: Enable or disable Trino cluster-wide (default: true)
  • trino_default_catalog: Default catalog used for Superset queries (default: hive)

These settings control the availability and default behavior of the Trino query engine across your Hopsworks cluster.

Best Practices for Trino Management#

  • Monitor regularly: Check cluster overview daily to spot trends and issues early
  • Review slow queries: Investigate queries with long execution times in the query history
  • Balance workload: Ensure workers are evenly distributed and not overloaded
  • Scale appropriately: Add workers during peak usage periods if resources are constrained
  • Track growth: Monitor query volume trends to plan for future capacity needs