AI Consultant Data Import Guide
Formats, structure and requirements for TileScore AI Consultant (Nanobot) training data
1. Architecture Overview
TileScore AI Consultant (Nanobot) uses RAG (Retrieval-Augmented Generation) architecture to provide accurate answers based on client data. The system combines vector search with full-text search for maximum relevance.
- Embedding Engine — DashScope text-embedding-v3, dimension 1024
- Vector search — pgvector (cosine similarity), threshold 0.3
- FTS — PostgreSQL tsvector with Russian morphology
- Cascading search — current tile → children → parents → guest tiles
- Chunking — 500 chars, overlap 100
2. Data Import Formats
| Channel | Formats | Purpose | Limit |
|---|---|---|---|
| KB Documents | PDF, TXT, MD, JSON | Texts, instructions | 10 MB, 100 files |
| KB Catalog | XLSX, XLS, CSV | Products, services, prices | 50 000 rows |
| URL Autofill | URL | Website parsing | 5 sites, 20 pages |
| Q&A Training | UI | Q&A pairs | Unlimited |
3. Knowledge Base Documents
Supported formats
| Format | Extension | Notes |
|---|---|---|
| Text | .txt | Plain UTF-8 text. Recommended. |
| Markdown | .md | Headers used as chunk delimiters. |
| Text-based only. Scans NOT supported. | ||
| JSON | .json | Validated and formatted. |
Requirements
- Min 10 chars, max 500,000
- UTF-8 encoding
- PDF: text-based only (not scans)
- Built-in spam check
TXT Example
# О компании Компания «Пример» основана в 2010 году. # Услуги 1. Консультирование — индивидуальный подход 2. Аудит — комплексная проверка # Контакты Телефон: +7 (999) 123-45-67
4. Catalog Data
Required fields
- name — Product/service name
- code — Unique code/SKU
Optional fields
- description — Detailed description
- category — Category/group
- price — Price in any format
- unit — Unit of measurement
- metadata — Additional properties (JSON)
CSV Example
Код;Наименование;Категория;Описание;Цена PN-001;Перчатки нитриловые;СИЗ;Размер M, синие;450 PN-002;Перчатки латексные;СИЗ;Размер L, белые;380 RS-010;Респиратор FFP2;СИЗ;Одноразовый;120
CSV delimiter — semicolon (;) or comma (,). Auto-detected. UTF-8 encoding.
Catalog search (3 levels)
- Exact code match (rank 100)
- Full-text search (FTS) with Russian morphology
- ILIKE fallback by keywords (≥4 chars)
5. URL Autofill
- Up to 5 websites
- Up to 20 subpages per site
- Text content extracted automatically
- Navigation and service blocks filtered
6. Training Q&A
| Category | Purpose |
|---|---|
| Passport | Basic company info |
| Q&A | Common client questions |
| Funnel | Sales funnel questions |
| Correction | AI answer corrections (highest priority) |
7. Limits
| Parameter | Value |
|---|---|
| Max file size | 10 MB |
| Max docs per tile | 100 |
| Min content length | 10 chars |
| Max content length | 500,000 chars |
| Encoding | UTF-8 |
| Document formats | PDF, TXT, MD, JSON |
| Catalog formats | XLSX, XLS, CSV |
| URL Autofill | 5 sites, 20 subpages |
| PDF OCR | Not supported |
8. Data Processing
Stage 1: Upload & Validation
Format, size, encoding check. Whitespace normalization. Spam and duplicate check.
Stage 2: Chunking
Chunk size: 500 chars. Overlap: 100 chars. Split at sentence boundaries.
Stage 3: Embedding
DashScope text-embedding-v3, 1024 dims → pgvector
Stage 4: Indexing
FTS (tsvector) + vector index + catalog code index
File → Validation → Chunking (500/100) → Embedding (1024d) → pgvector + FTS
9. Recommendations
Documents
- Use TXT or MD — most reliable formats
- One document = one topic
- Avoid tables in text files — use catalog
Catalogs
- First row — column headers
- Code must be unique
- Description — more detail = better search
Q&A
- Phrase questions like customers would
- Use "Correction" to fix AI errors