Issues

• Message queue to coordinate data processing

  disinfoRG/ZeroScraper#134 · Filter by author pm5 opened on Jul 13, 2021
  1

  

• Error when creating db using MariaDB

  disinfoRG/ZeroScraper#124 · Filter by author bwlynch opened on Jun 10, 2020
  1

• Selenium server

  disinfoRG/ZeroScraper#123 · Filter by author pm5 opened on Jun 4, 2020
  

• Create db using utf8mb4 format

  disinfoRG/ZeroScraper#122 · Filter by author bwlynch opened on Jun 3, 2020

• use md5 for url_hash

  disinfoRG/ZeroScraper#121 · Filter by author andreawwenyi opened on May 14, 2020
  

• api - add user table for individual username and password

  disinfoRG/ZeroScraper#119 · Filter by author andreawwenyi opened on May 14, 2020

• Chromedriver still creates zombie processes on middle2

  disinfoRG/ZeroScraper#118 · Filter by author pm5 opened on May 9, 2020

• some sites load too long during discover process

  disinfoRG/ZeroScraper#117 · Filter by author andreawwenyi opened on May 8, 2020

• selenium crash on M2

  disinfoRG/ZeroScraper#115 · Filter by author andreawwenyi opened on May 1, 2020

• use api for 今日頭條

  disinfoRG/ZeroScraper#109 · Filter by author andreawwenyi opened on Apr 15, 2020
  1

• Improve process management /w process start time

  disinfoRG/ZeroScraper#104 · Filter by author pm5 opened on Apr 6, 2020
  

• A customized url normalizer for our article

  disinfoRG/ZeroScraper#97 · Filter by author andreawwenyi opened on Mar 25, 2020

• the initium log in issue

  help wanted
  disinfoRG/ZeroScraper#96 · Filter by author andreawwenyi opened on Mar 25, 2020
  5

• Re-enable parallel crawling in site discover/update

  disinfoRG/ZeroScraper#85 · Filter by author pm5 opened on Mar 10, 2020
  2

• Error doing update on Dcard

  disinfoRG/ZeroScraper#83 · Filter by author pm5 opened on Mar 2, 2020
  3

• Do we really need selenium to read kknews and read01?

  disinfoRG/ZeroScraper#82 · Filter by author pm5 opened on Feb 28, 2020
  2

• Several oddities to the MySQL db

  disinfoRG/ZeroScraper#76 · Filter by author pm5 opened on Feb 20, 2020
  1

• update parallelism issue: many connection errors

  disinfoRG/ZeroScraper#74 · Filter by author andreawwenyi opened on Feb 19, 2020
  2

• Selenium start is quite slow on middle2

  enhancement
  disinfoRG/ZeroScraper#51 · Filter by author pm5 opened on Jan 25, 2020

• Spiders crawled links with inconsequential differences in URL parameters

  bug
  disinfoRG/ZeroScraper#44 · Filter by author pm5 opened on Jan 14, 2020
  4

• Find the optimal place for db queries to dedup

  enhancement
  disinfoRG/ZeroScraper#41 · Filter by author pm5 opened on Jan 14, 2020
  2

  

• Too many connections error

  bug
  disinfoRG/ZeroScraper#35 · Filter by author andreawwenyi opened on Jan 9, 2020
  2

• Airtable API timeouts

  disinfoRG/ZeroScraper#29 · Filter by author pm5 opened on Jan 1, 2020