Haystack Pipeline Skill
Capabilities
- Configure Haystack pipeline components
- Set up document stores and retrievers
- Implement reader/generator models
- Design custom pipeline graphs
- Configure preprocessing pipelines
- Implement evaluation pipelines
Target Processes
- rag-pipeline-implementation
- intent-classification-system
Implementation Details
Core Components
- DocumentStores: Elasticsearch, Weaviate, FAISS, etc.
- Retrievers: BM25, Dense, Hybrid
- Readers/Generators: Extractive and generative QA
- Preprocessors: Document cleaning and splitting
Pipeline Types
- Retrieval pipelines
- RAG pipelines
- Evaluation pipelines
- Indexing pipelines
Configuration Options
- Component selection
- Pipeline graph design
- Document store backend
- Model selection
- Preprocessing settings
Best Practices
- Modular pipeline design
- Proper preprocessing
- Evaluation integration
- Component versioning
Dependencies
- haystack-ai
- farm-haystack (legacy)