fix

.gitignore

@@ -59,7 +59,6 @@ coverage.xml
 *.pot
 
 # Django stuff:
-*.log
 local_settings.py
 db.sqlite3
 db.sqlite3-journal

SECURITY.md

@@ -3,9 +3,9 @@
 ## Supported Versions
 
 | Version | Supported          |
-| ------- | ------------------ |
-| >= 0.15   | :white_check_mark: |
-| < 0.15   | :x:                |
+|---------|--------------------|
+| >= 0.15 | :white_check_mark: |
+| < 0.15  | :x:                |
 
 ## Reporting a Vulnerability
 

docker-compose.yml

@@ -29,8 +29,8 @@ services:
     hostname: rabbitmq
     restart: on-failure
     ports:
-      - 15672:15672
-      - 5672:5672
+      - "15672:15672"
+      - "5672:5672"
     environment:
       TZ: Asia/Shanghai
       RABBITMQ_DEFAULT_USER: admin
@@ -48,7 +48,7 @@ services:
     volumes:
       - ./redis:/data
     ports:
-      - 6379:6379
+      - "6379:6379"
     networks:
       - app-tier
 

llmkira/sdk/filter/langdetect_fasttext/README.md

@@ -30,13 +30,13 @@ print(result)
 ## Benchmark
 We benchmarked the fasttext model against [cld2](https://github.com/CLD2Owners/cld2), [langid](https://github.com/saffsd/langid.py), and [langdetect](https://github.com/Mimino666/langdetect) on Wili-2018 dataset.
 
-|                          | fasttext    | langid      | langdetect  | cld2        |
-|--------------------------|-------------|-------------|-------------|-------------|
-| Average time (ms) | 0,158273381 | 1,726618705 | 12,44604317 | **0,028776978** |
-| 139 langs - not weighted   | 76,8        | 61,6        | 37,6        | **80,8**        |
-| 139 langs - pop weighted | **95,5**        | 93,1        | 86,6        | 92,7        |
-| 44 langs - not weighted    | **93,3**        | 89,2        | 81,6        | 91,5        |
-| 44 langs - pop weighted   | **96,6**        | 94,8        | 89,4        | 93,4        |
+|                          | fasttext    | langid      | langdetect  | cld2            |
+|--------------------------|-------------|-------------|-------------|-----------------|
+| Average time (ms)        | 0,158273381 | 1,726618705 | 12,44604317 | **0,028776978** |
+| 139 langs - not weighted | 76,8        | 61,6        | 37,6        | **80,8**        |
+| 139 langs - pop weighted | **95,5**    | 93,1        | 86,6        | 92,7            |
+| 44 langs - not weighted  | **93,3**    | 89,2        | 81,6        | 91,5            |
+| 44 langs - pop weighted  | **96,6**    | 94,8        | 89,4        | 93,4            |
 
 - `pop weighted` means recall for each language is multipled by [its number of speakers](https://en.wikipedia.org/wiki/List_of_languages_by_total_number_of_speakers).
 - 139 languages = all languages with ISO 639-1 2-letter code

llmkira/task/__init__.py

@@ -57,7 +57,7 @@ async def send_task(self, task: TaskHeader):
                 logger.error(
                     f"[5941163]Rabbitmq Queue param validation error, try deleting the abnormal queue manually and retrying. "
                     f"\n--error {e}"
-                    f"\n--help |web: http://<database_ip>:15672/#/ |shell: `rabbitmqctl delete_queue {self.queue_name}`"
+                    f"\n--help |web: <database_ip>:15672/#/ |shell: `rabbitmqctl delete_queue {self.queue_name}`"
                 )
                 raise e
             # Sending the message
@@ -101,7 +101,7 @@ async def consuming_task(self, func: callable):
                 logger.error(
                     f"[502231]Rabbitmq Queue parameter validation failed, try deleting the abnormal queue manually and retrying. "
                     f"\n--error {e}"
-                    f"\n--help |web: http://<database_ip>:15672/#/ |shell: `rabbitmqctl delete_queue {self.queue_name}`"
+                    f"\n--help |web: <database_ip>:15672/#/ |shell: `rabbitmqctl delete_queue {self.queue_name}`"
                 )
                 raise e
             await queue.consume(func)

requirements.txt

@@ -6,7 +6,6 @@ httpx>=0.24.1
 socksio
 
 pydantic<2.0.0
-beautifulsoup4
 python-dotenv
 
 elara
@@ -36,6 +35,5 @@ requests[socks]>=2.31.0
 feedparser==6.0.10
 pillow
 inscriptis
-bilibili-api-python
 duckduckgo_search>=3.9.3