Receber por email
← Voltar para o catálogo

rag-pipeline

Details on the Retrieval Augmented Generation pipeline, Ingestion, and Vector Search.

367estrelas
Atualizado há 4 meses

Ver no GitHub ↗

Como adicionar

/plugin marketplace add aiskillstore/marketplace

O comando exato pode variar conforme o repositório. Confira o README no GitHub.

Para o autor da skill

Cole no README do seu repo

Mostra que sua skill está catalogada na Skillteca, gera backlink e tráfego rastreável.

[![Skillteca](https://www.skillteca.com.br/api/badge/rag-pipeline/svg)](https://www.skillteca.com.br/skills/rag-pipeline)
#ai

Skills relacionadas

Ver todas de Segurança →

Alerta por categoria

Receba novas skills de Segurança toda segunda

1 email curto, só com as skills novas de Segurança. 4 minutos de leitura, sem spam, cancela com 1 clique.

Você confirma o email no primeiro envio. Sem spam. Cancela com 1 clique.

Ler descrição completa

RAG Pipeline Logic

Ingestion

  • Script: backend/ingest.py
  • Process:
  • Scans docs/.
  • Cleans MDX (removes frontmatter/imports).
  • Chunks text (1000 chars, 100 overlap).
  • Embeds using models/text-embedding-004.
  • Upserts to Qdrant collection physical_ai_book.
  • Run: python backend/ingest.py

Vector Search (Qdrant)

  • Client: qdrant-client
  • Collection: physical_ai_book
  • Vector Size: 768 (Gecko-004)
  • Similarity: Cosine

Prompt Engineering

  • File: backend/utils/helpers.py.
  • RAG Prompt: Constructs a prompt containing retrieved context chunks.
  • Personalization: backend/personalization.py creates system instructions based on software_background and hardware_background of the user.

Agentic Flow

We use a custom Agent class (backend/agents.py) that wraps the LLM calls, allowing for future expansion into multi-agent workflows.

Compartilhar X LinkedIn