RecursiveUrlLoader
. It accepts a URL, recursively loads pages, and converts them into documents
. These documents are converted into embeddings, submitted to a Kafka topic, and consumed by Apache Pinot.
To understand how this recipe processes data, examine the commands executed in the Makefile.
Pinot Version | 1.1.0 |
---|---|
Code | startreedata/pinot-recipes/genai |
No space left on device
when building the container. Execute the command below to free resources before building.