Intermediate · Retrieval
Vector search in Postgres Search the help desk's passages in Postgres with pgvector: a table of passages and their vectors, an approximate index, searches within one service, a review of an assistant's queries, and a search whose indexes fit a small budget.
You build store.py, then index.py, then service.py, then queries.py, then desk.py
Stages 3 Build, 1 Catch, 1 Ship
Time About 3 hours
Runs on Your machine Loading the workspace…
Loading the workspace…
Data: MultiDoc2Dial , by Song Feng, Siva Sankalp Patel, Hui Wan, Sachindra Joshi, CC BY 3.0 . The dataset's 488 help pages in passages: each page's text taken from its HTML, with its headings marked by #s and its list items by -, and its blocks joined into passages of up to 200 words. Each passage has its page, the page's domain, and the page's title without the part number the dataset adds.
Data: MultiDoc2Dial , by Song Feng, Siva Sankalp Patel, Hui Wan, Sachindra Joshi, CC BY 3.0 . The opening question of each dialogue whose next turn answers it from the same page: 500 of the dataset's training dialogues, chosen at random, for validation, and 362 of its validation dialogues, for testing.
Data: MultiDoc2Dial , by Song Feng, Siva Sankalp Patel, Hui Wan, Sachindra Joshi, CC BY 3.0 . For each question, the passages that hold at least half of a part of the page its answer was given from, and every passage with the same text as one of them.
Data: MultiDoc2Dial , by Song Feng, Siva Sankalp Patel, Hui Wan, Sachindra Joshi, CC BY 3.0 . Each passage's vector from nomic-embed-text-v1.5 at 8 bits, embedded after `search_document: `, one text a request, by llama.cpp's server, release b11734, each number times 32,767, rounded.
Data: MultiDoc2Dial , by Song Feng, Siva Sankalp Patel, Hui Wan, Sachindra Joshi, CC BY 3.0 . Each question's vector from nomic-embed-text-v1.5 at 8 bits, embedded after `search_query: `, one text a request, by llama.cpp's server, release b11734, each number times 32,767, rounded.