dohyune commited on
Commit
67f4cf0
ยท
verified ยท
1 Parent(s): 53c964c

Update requirements.txt

Browse files
Files changed (1) hide show
  1. requirements.txt +48 -7
requirements.txt CHANGED
@@ -1,7 +1,48 @@
1
- streamlit==1.31.0
2
- pymupdf>=1.24.0
3
- chromadb==0.4.24
4
- sentence-transformers==2.3.1
5
- requests==2.31.0
6
- numpy==1.26.3
7
- python-dotenv==1.0.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # PyTorch CPU ๋ฒ„์ „ ๋‹ค์šด๋กœ๋“œ๋ฅผ ์œ„ํ•œ ์ธ๋ฑ์Šค ์„ค์ • (ํŒŒ์ผ ์ตœ์ƒ๋‹จ ์œ„์น˜)
2
+ --extra-index-url https://download.pytorch.org/whl/cpu
3
+
4
+ # Core & Utils
5
+ numpy==1.26.4
6
+ python-dotenv
7
+ requests
8
+ pyyaml
9
+ jsonschema
10
+ pydantic>=2.0
11
+ pytest
12
+
13
+ # LLM Clients
14
+ openai
15
+ xai-sdk
16
+
17
+ # Web / UI
18
+ streamlit
19
+
20
+ # PDF Processing (PyPDF2 ์ œ๊ฑฐ, ํ•ต์‹ฌ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋งŒ ์œ ์ง€)
21
+ PyMuPDF
22
+ pdfplumber
23
+ pdf2image
24
+ # OCR์ด ๊ผญ ํ•„์š”ํ•œ ๊ฒฝ์šฐ๋งŒ ์œ ์ง€ (์‹œ์Šคํ…œ์— Tesseract ์„ค์น˜ ํ•„์š”)
25
+ pytesseract
26
+ Pillow
27
+
28
+ # Vector DB
29
+ # 0.4.14๋Š” Pydantic v2์™€ ์ถฉ๋Œ ๊ฐ€๋Šฅ์„ฑ์ด ์žˆ์œผ๋ฏ€๋กœ ์ตœ์‹  ์•ˆ์ • ๋ฒ„์ „ ๊ถŒ์žฅ
30
+ # ๊ผญ 0.4.14๋ฅผ ์จ์•ผ ํ•œ๋‹ค๋ฉด pydantic ๋ฒ„์ „์„ ํ™•์ธํ•ด์•ผ ํ•จ
31
+ chromadb>=0.4.14
32
+
33
+ # ML / NLP / Torch
34
+ # ๋ณด์•ˆ ์ด์Šˆ๋กœ ์ธํ•ด torch 2.6.0 ์ด์ƒ ํ•„์ˆ˜ ์œ ์ง€
35
+ torch==2.6.0 --index-url https://download.pytorch.org/whl/cpu
36
+ torchvision==0.21.0
37
+ torchaudio==2.6.0
38
+
39
+ # torch 2.6.0๊ณผ ํ˜ธํ™˜๋˜๋„๋ก transformers๋ฅผ ์ตœ์‹  ๋ฒ„์ „์œผ๋กœ ์—…๊ทธ๋ ˆ์ด๋“œ
40
+ # 4.46.3 -> ์ตœ์‹  ๋ฒ„์ „ (์ตœ์†Œ 4.48.0 ์ด์ƒ ๊ถŒ์žฅ)
41
+ transformers>=4.48.0
42
+
43
+ # sentence-transformers๋„ ์ด์— ๋งž์ถฐ ์—…๊ทธ๋ ˆ์ด๋“œ
44
+ sentence-transformers>=3.3.0
45
+
46
+ # ๊ฐ€์†ํ™” ๋ฐ ํ˜ธํ™˜์„ฑ์„ ์œ„ํ•ด accelerate ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ ์ถ”๊ฐ€ ๊ถŒ์žฅ (์ตœ์‹  torch ์‚ฌ์šฉ ์‹œ ํ•„์ˆ˜์ธ ๊ฒฝ์šฐ๊ฐ€ ๋งŽ์Œ)
47
+ accelerate>=0.26.0
48
+ scikit-learn