Setting Up Apache Pinot: A Step-by-Step Guide

Prerequisites

Before proceeding, ensure you have Java installed on your system. You can verify this by running:

java -version

$ java -version
java version "21.0.4" 2024-07-16 LTS
Java(TM) SE Runtime Environment (build 21.0.4+8-LTS-274)
Java HotSpot(TM) 64-Bit Server VM (build 21.0.4+8-LTS-274, mixed mode, sharing)

Follow below step-by-step procedure to run the Apache Pinot in your computer.

 

Step 1: Download Apache Pinot

 

Visit the official Apache Pinot website and download the latest version of Pinot. At the time of writing, the latest version is 1.3.0.

 

Once downloaded, extract the ZIP file. Inside the extracted folder bin directory, you will find all the necessary executable shell scripts.

 

$ls
LICENSE			bin			examples		licenses		plugins-external
NOTICE			conf			lib			plugins
$
$ls bin
pinot-admin.sh					quick-start-json-index-streaming.sh
pinot-fs-util.sh				quick-start-partial-upsert-streaming.sh
pinot-tools.sh					quick-start-streaming.sh
query-runner.sh					quick-start-upsert-streaming.sh
quick-start-auth-zk.sh				star-tree-index-viewer.sh
quick-start-auth.sh				start-broker.sh
quick-start-batch.sh				start-controller.sh
quick-start-complex-type-handling-offline.sh	start-minion.sh
quick-start-complex-type-handling-streaming.sh	start-server.sh
quick-start-hybrid.sh				start-service-manager.sh
quick-start-json-index-batch.sh

Step 2: Start Apache Pinot Components

Pinot consists of multiple components that need to be started in sequence. Below are the commands for each.

 

Start Zookeeper

Zookeeper is a prerequisite for running Pinot.

 

bin/pinot-admin.sh StartZookeeper -zkPort 2191 > ./zookeeper-console.log 2>&1 &

Start Controller

The controller manages metadata and coordinates Pinot clusters. Run the following command:

bin/pinot-admin.sh StartController -zkAddress localhost:2191 -controllerPort 9000 > ./controller-console.log 2>&1 &

Start Broker

The broker component is responsible for query routing and execution.

 

bin/pinot-admin.sh StartBroker -zkAddress localhost:2191 > ./broker-console.log 2>&1 &

Start Server

The server stores and indexes data for fast retrieval.

 

bin/pinot-admin.sh StartServer -zkAddress localhost:2191 > ./server-console.log 2>&1 &

Step 3: Verify Running Processes

To ensure that all Pinot processes are running, execute below command from the terminal.

 

ps -eaf | grep "pinot"

 

This will list all active Pinot-related processes.

 

Step 4: Access Pinot Data Explorer

 

Once all components are running, you can access the Pinot Data Explorer by opening the following URL in your browser:

http://localhost:9000

This UI allows you to explore tables, execute queries, and monitor cluster health.  

With this, you have successfully set up Apache Pinot on your local machine. You can now begin ingesting data and running queries.

Previous                                                    Next                                                    Home