Using MinIO as Deep Store for an Offline Table

In this recipe we’ll learn how to use MinIO as a Pinot deep store. To understand how this recipe processes data, examine the commands executed in the Makefile.

Pinot Version	1.1.0
Code	startreedata/pinot-recipes/minio

Prerequisites

To follow the code examples in this guide, do the following:

Install Docker.
Download recipes

Makefile

Clone this repository and navigate to this recipe:

make recipe

Validate

Check that minio has the segment in the deep store. You can also log into the minio console and check. http://localhost:9001/browser/deepstore.

docker exec minio mc ls myminio/deepstore/transcript

Clean up

make clean

Troubleshooting

To clean up old Docker installations that may be interfering with your testing of this recipe, run the following command:

docker system prune

⌘I

​Prerequisites

​Makefile

​Validate

​Clean up

​Troubleshooting

Prerequisites

Makefile

Validate

Clean up

Troubleshooting