Code

重写网络接口#391

Code

Draft

glyh wants to merge 10 commits intomasterYuukiy/JavSP:masterfrom refactor-network-aiohttpYuukiy/JavSP:refactor-network-aiohttpCopy head branch name to clipboard

+3,456-3,031

Commits

Commits on Sep 28, 2024

• checkpoint push: single crawler works, but __main__ broken

  glyh

  committed
  26c33ff

  Copy full SHA for 26c33ff

• drop cloudscraper

  glyh

  committed
  f72a375

  Copy full SHA for f72a375

• fix asyncio proxyfree test, use uvloop for main loop

  glyh

  committed
  264c7b7

  Copy full SHA for 264c7b7

• remove uvloop as poetry can't build it on old python

  glyh

  committed
  629f14c

  Copy full SHA for 629f14c

• don't use uvloop for unittest

  glyh

  committed
  dd0d83b

  Copy full SHA for dd0d83b

• remove prints

  glyh

  committed
  e2a43c7

  Copy full SHA for e2a43c7

• attempt to fix proxyfree fail

  glyh

  committed
  5ed7f36

  Copy full SHA for 5ed7f36

Commits on Sep 29, 2024

• refactor network with aiohttp

  glyh

  committed
  9729542

  Copy full SHA for 9729542

• test web crawlers first

  glyh

  committed
  a6230ec

  Copy full SHA for a6230ec

• fix: remove extra /, make links absolute

  glyh

  committed
  9f0499d

  Copy full SHA for 9f0499d