LLM (Llama 2) Web Crawler Seed Expander

Tsubasa Kato
Sep 30, 2023

--

This is a concept demo of using LLM (Llama 2 by Meta) to expand a query that is inputted by the LLM and send the web crawler a JSON response that contains the expanded words (in this case sentences that are generated) as seed to start crawling.

©️Tsubasa Kato

Inspire Search Corporation

LinkedIn: https://www.linkedin.com/in/tsubasakato

--

--

Tsubasa Kato
Tsubasa Kato

Written by Tsubasa Kato

Japanese Search Engineer. Likes Quantum Computers and handheld computers.

No responses yet