The `question-parser.ts` file contains utilities for parsing questions and answers from content. While it defines interfaces and helper functions, the primary AI-powered parsing logic for the main questionnaire service flow is handled by `content-extractor.ts` through its `extractQuestionsWithAI` function, which internally utilizes various AI models.
Sources:
[apps/api/src/questionnaire/questionnaire.service.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.service.ts#L56-L63)
[apps/api/src/questionnaire/questionnaire.service.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.service.ts#L104-L110)
[apps/api/src/questionnaire/utils/content-extractor.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/utils/content-extractor.ts#L125-L132)
| Method | Endpoint | Description
classDiagram
class QuestionnaireService {
+parseQuestionnaire(dto: ParseQuestionnaireDto): ParsedQuestionnaireResult
+autoAnswerAndExport(dto: ExportQuestionnaireDto): QuestionnaireExportResult
+uploadAndParse(dto: UploadAndParseDto): { questionnaireId: string; totalQuestions: number }
+answerSingleQuestion(dto: AnswerSingleQuestionDto): AnswerQuestionResult
+saveAnswer(dto: SaveAnswerDto): { success: boolean; error?: string }
+exportById(dto: ExportByIdDto): ExportResult
+deleteAnswer(dto: DeleteAnswerDto): { success: boolean; error?: string }
+saveGeneratedAnswerPublic(params: { questionnaireId: string; questionIndex: number; answer: string; sources?: AnswerQuestionResult['sources'] }): void
-generateAnswersForQuestions(questionsAndAnswers: QuestionnaireAnswer[], organizationId: string): QuestionnaireAnswer[]
}
class QuestionnaireController {
+parseQuestionnaire(dto: ParseQuestionnaireDto): ParsedQuestionnaireResult
+answerSingleQuestion(dto: AnswerSingleQuestionDto): any
+saveAnswer(dto: SaveAnswerDto): { success: boolean; error?: string }
+deleteAnswer(dto: DeleteAnswerDto): { success: boolean; error?: string }
+exportById(dto: ExportByIdDto, res: Response): Promise
+uploadAndParse(dto: UploadAndParseDto): { questionnaireId: string; totalQuestions: number }
+uploadAndParseUpload(file: Express.Multer.File, body: { organizationId: string; source?: 'internal' | 'external' }): any
+parseQuestionnaireUpload(file: Express.Multer.File, body: { organizationId: string; format?: 'pdf' | 'csv' | 'xlsx'; source?: 'internal' | 'external' }, res: Response): Promise
+parseQuestionnaireUploadByToken(file: Express.Multer.File, token: string, body: { format?: 'pdf' | 'csv' | 'xlsx' }, res: Response): Promise
+autoAnswerAndExport(dto: ExportQuestionnaireDto, res: Response): Promise
+autoAnswerAndExportUpload(file: Express.Multer.File, body: { organizationId: string; format?: 'pdf' | 'csv' | 'xlsx' }, res: Response): Promise
+autoAnswer(dto: AutoAnswerDto, res: Response): Promise
}
class ParseQuestionnaireDto {
+vendorName?: string
+fileName?: string
+fileType: string
+fileData: string
}
class ExportQuestionnaireDto {
+organizationId: string
+fileData: string
+fileType: string
+fileName?: string
+vendorName?: string
+format: 'pdf' | 'csv' | 'xlsx'
+source?: 'internal' | 'external'
+exportInAllExtensions?: boolean
}
class AnswerSingleQuestionDto {
+questionnaireId: string
+organizationId: string
+question: string
+questionIndex: number
+totalQuestions: number
}
class AutoAnswerDto {
+organizationId: string
+questionnaireId?: string
+questionsAndAnswers: AutoAnswerQuestionDto[]
}
class AutoAnswerQuestionDto {
+question: string
+answer?: string | null
+_originalIndex?: number
}
class SaveAnswerDto {
+questionnaireId: string
+organizationId: string
+questionAnswerId?: string
+questionIndex?: number
+answer?: string | null
+status: 'manual' | 'generated'
+sources?: any
}
class DeleteAnswerDto {
+questionnaireId: string
+organizationId: string
+questionAnswerId: string
}
class UploadAndParseDto {
+organizationId: string
+fileName: string
+fileType: string
+fileData: string
+source?: 'internal' | 'external'
}
class ExportByIdDto {
+questionnaireId: string
+organizationId: string
+format: 'pdf' | 'csv' | 'xlsx'
}
class QuestionnaireAnswer {
+question: string
+answer: string | null
+sources?: any
}
class ParsedQuestionnaireResult {
+vendorName?: string
+fileName?: string
+totalQuestions: number
+questionsAndAnswers: QuestionnaireAnswer[]
}
class QuestionnaireExportResult {
+fileBuffer: Buffer
+mimeType: string
+filename: string
+questionsAndAnswers: QuestionnaireAnswer[]
}
QuestionnaireController --|> QuestionnaireService : uses
QuestionnaireService ..> ParseQuestionnaireDto
QuestionnaireService ..> ExportQuestionnaireDto
QuestionnaireService ..> AnswerSingleQuestionDto
QuestionnaireService ..> SaveAnswerDto
QuestionnaireService ..> DeleteAnswerDto
QuestionnaireService ..> UploadAndParseDto
QuestionnaireService ..> ExportByIdDto
QuestionnaireService ..> QuestionnaireAnswer
QuestionnaireService ..> ParsedQuestionnaireResult
QuestionnaireService ..> QuestionnaireExportResult
AutoAnswerDto o-- AutoAnswerQuestionDto : contains
```
Sources:
[apps/api/src/questionnaire/questionnaire.service.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.service.ts#L34-L46)
[apps/api/src/questionnaire/questionnaire.controller.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.controller.ts#L32-L36)
[apps/api/src/questionnaire/dto/parse-questionnaire.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/parse-questionnaire.dto.ts)
[apps/api/src/questionnaire/dto/export-questionnaire.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/export-questionnaire.dto.ts)
[apps/api/src/questionnaire/dto/answer-single-question.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/answer-single-question.dto.ts)
[apps/api/src/questionnaire/dto/auto-answer.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/auto-answer.dto.ts)
[apps/api/src/questionnaire/dto/save-answer.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/save-answer.dto.ts)
[apps/api/src/questionnaire/dto/delete-answer.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/delete-answer.dto.ts)
[apps/api/src/questionnaire/dto/upload-and-parse.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/upload-and-parse.dto.ts)
[apps/api/src/questionnaire/dto/export-by-id.dto.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/dto/export-by-id.dto.ts)
## Automatic Answering
The module provides robust capabilities for automatically generating answers to questionnaire questions using a Retrieval Augmented Generation (RAG) approach.
### Answer Generation Process
The `QuestionnaireService` orchestrates the automatic answering process:
1. **Sync Organization Embeddings:** Before generating answers, the system ensures that the organization's knowledge base (policies, manual answers, etc.) is synchronized with the vector store. This step is crucial for accurate retrieval.
2. **Batch Search:** For efficiency, questions are batched, and a single call to `findSimilarContentBatch` is made to retrieve relevant context from the vector store for all questions simultaneously.
3. **Answer Generation:** For each question, `generateAnswerFromContent` is called, which uses the retrieved context and an AI model (e.g., `generateAnswerWithRAGBatch` in the service) to formulate an answer.
4. **Save Answer:** Generated answers, along with their sources, are saved to the database.
5. **Update Answered Count:** The total count of answered questions for the questionnaire is updated.
### Streaming Auto-Answer (SSE)
The `autoAnswer` endpoint in the `QuestionnaireController` provides a Server-Sent Events (SSE) stream to give real-time feedback on the answer generation progress.
### Establish SSE Connection
The controller sets up SSE headers and creates a safe sender function to stream events back to the client.
### Sync Embeddings
The `QuestionnaireService` first attempts to synchronize the organization's embeddings to ensure the vector store is up-to-date. Warnings are logged if this fails, but the process continues.
### Filter Unanswered Questions
The incoming list of questions is filtered to identify those that still require an answer.
### Batch Context Search
A progress event (`type: 'progress'`, `phase: 'searching'`) is sent. The system then performs a batch search (`findSimilarContentBatch`) against the vector store to retrieve relevant content for all unanswered questions. This is a critical optimization to reduce latency.
### Parallel Answer Generation
Another progress event (`type: 'progress'`, `phase: 'generating'`) is sent. Answers are then generated in parallel for each question using the pre-fetched content (`generateAnswerFromContent`).
### Stream Individual Answers
As each answer is generated, an `answer` event is streamed back to the client, including the question, generated answer, sources, and success status.
### Save Generated Answers
Each generated answer is persisted to the database via `saveGeneratedAnswerPublic` in the `QuestionnaireService`.
### Complete Stream
Once all questions are processed, a `complete` event is sent, summarizing the total and answered questions. The SSE connection is then closed.
Sources:
[apps/api/src/questionnaire/questionnaire.service.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.service.ts#L225-L269)
[apps/api/src/questionnaire/questionnaire.controller.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.controller.ts#L368-L476)
[apps/api/src/vector-store/lib/index.ts](https://github.com/blade47/comp/blob/main/apps/api/src/vector-store/lib/index.ts)
[apps/api/src/trigger/questionnaire/answer-question-helpers.ts](https://github.com/blade47/comp/blob/main/apps/api/src/trigger/questionnaire/answer-question-helpers.ts)
```mermaid
sequenceDiagram
actor Client
participant Controller as QuestionnaireController
participant Service as QuestionnaireService
participant VectorStore as Vector Store
participant AI as AI Models
participant DB as Database
participant S3 as S3 Storage
Client->>Controller: POST /auto-answer (AutoAnswerDto)
Controller->>Controller: setupSSEHeaders()
Controller->>Service: syncOrganizationEmbeddings(orgId)
Service->>VectorStore: syncOrganizationEmbeddings(orgId)
VectorStore-->>Service: Sync Status
Service-->>Controller:
Controller->>Client: SSE: progress (phase: searching)
Controller->>VectorStore: findSimilarContentBatch(questions, orgId)
VectorStore-->>Controller: allSimilarContent[]
Controller->>Client: SSE: progress (phase: generating)
loop For each question
Controller->>AI: generateAnswerFromContent(question, similarContent)
AI-->>Controller: AnswerResult {answer, sources}
Controller->>Service: saveGeneratedAnswerPublic(questionnaireId, questionIndex, answer, sources)
Service->>DB: Update questionnaireQuestionAnswer
DB-->>Service:
Service->>QuestionnaireStorage: updateAnsweredCount(questionnaireId)
QuestionnaireStorage->>DB: Update questionnaire.answeredQuestions
DB-->>QuestionnaireStorage:
QuestionnaireStorage-->>Service:
Service-->>Controller:
Controller->>Client: SSE: answer {questionIndex, answer, sources}
end
Controller->>Client: SSE: complete {total, answered, answers}
Controller->>Client: Close SSE connection
```
Sources:
[apps/api/src/questionnaire/questionnaire.controller.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.controller.ts#L368-L476)
[apps/api/src/questionnaire/questionnaire.service.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/questionnaire.service.ts#L225-L269)
[apps/api/src/vector-store/lib/index.ts](https://github.com/blade47/comp/blob/main/apps/api/src/vector-store/lib/index.ts)
[apps/api/src/trigger/questionnaire/answer-question-helpers.ts](https://github.com/blade47/comp/blob/main/apps/api/src/trigger/questionnaire/answer-question-helpers.ts)
[apps/api/src/questionnaire/utils/questionnaire-storage.ts](https://github.com/blade47/comp/blob/main/apps/api/src/questionnaire/utils/questionnaire-storage.ts#L22-L36)
### DTOs for Auto-Answering
| DTO Class | Description
```
## Sitemap
See the full [sitemap](https://www.doc0.dev/docs/49c89830-117b-4def-8edc-b5bcc50766e0/llms.txt) for all pages in this wiki.