README.md

Spider

Default Multithreading Execution, Simultaneously Crawling Data from QQ Music, Netease Cloud Music, and Bilibili Videos

Description

The spider can run independently

Independent run

1. Please copy folder api/spider, models, config, and deppendent to create a project
2. Modify API/spider/__ Init__ Introduction of py files

from api.spider import bilibili, neteasemusic, qqmusic
# change 👇
from spider import bilibili, neteasemusic, qqmusic

3. create main.py

import spider

if __name__ == "__main__":
    spider_obj = spider

deppendent

• requests~=2.31.0
• PyMySQL~=1.1.0
• tqdm~=4.66.1
• beautifulsoup4~=4.12.2
• sqlalchemy~=2.0.23

pip install -r requirement.txt

# Creating a virtual environment
python -m venv venv

# Using virtual environments
# -windows Platform
./venv/Scripts/activate
# -Linux Platform
source /venv/bin/activate

Bilibili

Accessible Rankings

• up主信息
  • 粉丝数
  • 关注数
  • 视频时长
  • 获赞数
• 每周必看
• 入站必刷
• 综合热门
• 排行榜

Netease Music

Accessible Rankings

QQ Music

Accessible Rankings