Essays Note 12 of 14
The AIGC Era
The main problems being solved right now are text-to-image generation and intelligent Q&A chatbots
Deploying Stable Diffusion for Text-to-Image
- Servers are typically AWS, Runpod, Tencent, or Alibaba
- Framework: Stable Diffusion
- Core: text-to-image models
- Tuning LoRA: weight 0.3-0.8
- ControlNet preprocessing <TTP’s RAG>
- The output is an API for the front end to call
Intelligent Q&A: LLM <---> SLM Configuration
-
Problems faced
-
Ethics
-
Hallucination
-
Timeliness
-
Model selection: ChatGPT, Ollama, Meta, others
-
Basis for reference: HuggingFace popularity and QAnything evaluations
-
Commercial solution
-
User input
-
Model library
-
Knowledge base <---> online/offline
-
Where the three meet, hand it over to RAG
-
RAG (Retrieval-Augmented Generation) ---> GraphRAG, deployed with Langchain
-
User input content
-
Embedding model
-
Rerank model <context reranking, reduces the large model’s memory consumption>
-
RAG processing
-
Knowledge base embedding
-
LLM processes and returns the result